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The Two-user Causal Cognitive Interference 
Channel: Novel Outer Bounds and Constant 
Gap Result for the Symmetric Gaussian Noise 
Channel in Weak Interference 

Martina Cardone, Daniela Tuninetti and Raymond Knopp 


Abstract 

This paper studies the two-user Causal Cognitive Interference Channel (CCIC), where two trans¬ 
mitters aim to communicate independent messages to two different receivers via a common channel. 

One source, referred to as the cognitive , is capable of overhearing the other source, referred to as the 
primary , through a noisy in-band link and thus can assist in sending the primary’s data. Two novel outer 
bounds of the type 2 R p + R c and R p + 2 R c are derived for the class of injective semi-deterministic 
CCICs where the noises at the different source-destination pairs are independent. An achievable rate 
region is derived based on Gelfand-Pinsker binning, superposition coding and simultaneous decoding 
at the receivers. 

The lower and outer bounds are then specialized to the practically relevant Gaussian noise case. 

The authors of this paper recently characterized to within a constant gap the capacity of the symmetric 
Gaussian CCIC in (a) the strong interference regime, and (b) for a subset of the weak interference 
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regime when the cooperation link is larger than a given threshold. This work characterizes to within 
a constant gap the capacity for the symmetric Gaussian CCIC in the regime that was still open. In 
particular, it is shown that the novel outer bounds are necessary to characterize the capacity to within a 
constant gap when the cooperation link is weaker than the direct links, that is, in this regime unilateral 
cooperation leaves some system resources underutilized. 

Index Terms 

Achievable rate region, causal cooperation, channel capacity, cognitive radio, constant gap, inter¬ 
ference channel, outer bound region, unilateral source cooperation. 

I. Introduction 

This work considers the two-user Causal Cognitive Interference Channel (CCIC), a wireless 
network where one primary source PTx and one cognitive / capable source CTx aim to reliably 
communicate with two different receivers, namely the PRx and the CRx, via a common channel. 
Differently from the classical non-cooperative IC, in the CCIC the CTx operates in full-duplex 
mode and is able to overhear the PTx through a noisy in-band link; the CTx can thus exploit 
this side information to boost the performance of the two (primary and cognitive) systems. 

The major feature of the CCIC is the concept of causal cognition / source cooperation , 
which represents both an interference management tool and a practical model for the cognitive 
radio technology. Actually, unilateral source cooperation offers a way to smartly cope with 
interference. In today’s wireless systems, the general approach to deal with interference is either 
to avoid it, by trying to orthogonalize (in time / frequency / space) users’ transmission, or to 
treat it as noise. However, these approaches may severely limit the system capacity since perfect 
user orthogonalization is not possible in practice. In contrast, in the CCIC the CTx, which can 
causally leam the primary’s data through a noisy link, may protect both its own (by precoding 
against some known interference) and the primary’s (by allocating some of its transmission 
resources to assist the PTx to convey data to the PRx) information from interference. Thus, the 
transmission techniques designed for the CCIC aim to leverage the structure of the interference, 
instead of just simply disregarding it and treating it as noise. The CCIC also represents a more 
practically relevant model for the cognitive overlay paradigm, compared to the case where the 
CTx is assumed to a priori (before the transmission begins) know the message of the PTx [0, 
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which may be granted only in limited scenarios. In contrast, in the CCIC the CTx causally learns 
the PTx’s data through a noisy link. Thus, the transmission techniques designed for the CCIC 
account for the time the CTx needs for decoding and for the (possible) further rate losses that 
may incur in decoding the PTx’s message through a noisy link of limited capacity. 

A. Related past work 

The CCIC studied in this work models an IC with unilateral source cooperation and represents 
a practical scenario for cognitive radios, where one source has superior capabilities with respect 
to the other source. Moreover, closely related to the IC with unilateral source cooperation is the 
IC with perfect output feedback model, where the received signal is fed back through a perfect 
channel from one receiver to the corresponding transmitter. Lately, these scenarios have received 
significant attention, as summarized next. 

1) IC with source cooperation: The CCIC is a particular case of the IC with bilateral source 
cooperation, where one of the cooperation link (in our case the one from the CTx to the PTx) is 
absent. For the IC with bilateral source cooperation several outer bounds on the capacity region 
were derived in 0, 0, 0, 0 and a number of transmission strategies were designed in 0. 

In 0, the author firstly derived inner and outer bounds on the capacity for the IC with bilateral 
source cooperation and for the IC with bilateral destination cooperation. The outer bound region 
was obtained from the max-flow-min-cut theorem, by further strengthening the sum-rate bound 
R p + R c (where R p , respectively R c , is the transmission rate for the PRx, respectively the CRx) 
as proposed in 0, while the lower bound region was derived by designing a scheme based on 
Gelfand-Pinsker’s binning lITOl (i.e., dirty-paper-coding in Gaussian noise ifTTIl ! and superposition 
encoding, decode-and-forward relaying and simultaneous decoding. 

In [0, the author derived a novel general outer bound for the IC with bilateral source 
cooperation that applies to any channel, i.e., the noises can be arbitrarily correlated. The outer 
bound rate region in (5} Theorem II. 1] has constraints on the single rates R p and R c and on 
the sum-rate R p + R c . In particular, the constraints on the sum-rate were obtained by extending 
the idea of Kramer in lfl2l Theorem 1], beyond the Gaussian noise case. Moreover, the outer 
bounds in [0 Theorem II. 1] were recently shown to hold for the case of bilateral destination 
cooperation as well [|T3ll . When evaluated for the symmetric Gaussian noise case, the derived 
region is achievable to within 2 bits in the strong cooperation regime llT4ll . 


March 26, 2015 


DRAFT 


4 


In [[6j, the authors derived a novel sum-rate outer bound for a class of Injective Semi- 
Deterministic (ISD) ICs with bilateral source cooperation and with independent noises at all 
terminals; when evaluated for the Gaussian noise case with symmetric cooperation links, the 
derived region is achievable to within 19 bits. 

In 0, the authors derived a novel outer bound on the capacity region of the Gaussian IC 
with bilateral source cooperation that are based on the idea of ‘dependence balance’ proposed 
in 03). In 0 it was proved that the novel bound region may be tighter than the cut-set bound. 

In 0 two transmission strategies for the IC with bilateral source cooperation were designed. 
The two schemes employ partial-decode-and-forward relaying, rate splitting and simultaneous 
decoding. While the first strategy (see DU Section IV]) uses only superposition coding, the second 
scheme (see DU Section V]) also employs Gelfand-Pinsker’s binning in the encoding phase. 

The CCIC was specifically studied in 06l . where novel outer and inner bounds were derived. 
Although, to the best of our knowledge, the work in Ifl6l gives the best known bounds for this 
channel, their evaluation is not straightforward. For example, the outer bound involves several 
auxiliary random variables that are jointly distributed with the inputs and for which no cardinality 
bounds on the corresponding alphabets are known; the inner bound is characterized by many 
constraints and auxiliary random variables whose optimization is not immediate. 

In 071 . the capacity of the Gaussian CCIC (GCCIC) was characterized to within a constant 
gap for a set of channel parameters that, roughly speaking, excludes the case of weak interference 
at both receivers. For the symmetric case (i.e., the two direct links and the two interfering links 
are of the same strength) a constant gap result of 1 bit was proved in strong interference and 
in weak interference when the cooperation link is ‘sufficiently strong’. Moreover, in DTTil . the 
capacity of the GCCIC was characterized to within 2 bits for two special cases: the Z-channel, 
where the CRx does not experience interference from the PTx, and the S-channel, where the 
PRx does not experience interference from the CTx. These constant gap results were obtained 
by using known outer bounds on the single rates R p and R c and on the sum-rate R p + R c . 

In DT71 we pointed out that in weak interference the capacity region of the GCCIC should also 
have outer bounds of the type 2 R p + R c and R p + 2 R c , similarly to the classical non-cooperative 
IC Dl8l . To the best of our knowledge, these bounds are not available in the existing literature of 
cooperative ICs and their derivation represents the main contribution of this work. These novel 
bounds are proved to be active for the symmetric GCCIC in weak interference and when the 
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cooperation link is weaker than the direct link, thus closing a problem left open in liTTlI . 

2) IC with output feedback: In [fl9l , the authors studied the Gaussian IC where each source 
has a perfect output feedback from the intended destination and characterized the capacity to 
within 2 bits. In [H9l Theorems 2-3], the capacity region has constraints on the single rates R p 
and R c and on the sum-rate R p + R c , but not bounds of the type 2 R p + R c and R p + 2 R c , which 
appear in the capacity region of the classical Gaussian IC in weak interference l!T8l . The authors 
interpreted the bounds on 2 R p + R c and R p + 2 R c in the capacity region of the classical IC as 
a measure of the amount of ‘resource holes’, or system under utilizations, due to the distributed 
nature of the non-cooperative IC. The authors thus concluded that output feedback eliminates 
these ‘resource holes’, i.e., the system resources are fully utilized. 

In POL the symmetric Gaussian IC with all 9 possible output feedback configurations was 
analyzed. The authors proved that the bounds derived in 1(191 suffice to approximately characterize 
the capacity of all the 9 configurations except for the case where only one source receives 
feedback from the corresponding destination, i.e., the ‘single direct-link feedback model’, or the 
feedback-model-(lOOO). For the feedback-model-(lOOO), it was shown that an outer bound of 
the type 2 R p + R c is needed to capture the fact that the second source (whose transmission rate 
is R c ) does not receive feedback. In the language of |fT9l we thus have that a ‘single direct-link 
feedback’ does not suffice to cover all the ‘resource holes’ whose presence is captured by the 
bound on 2 R p + R c . Such a bound was shown to be active for the feedback-model-(lOOO) in the 
Gaussian noise case. 

In PH . the authors characterized the capacity of the two-user symmetric linear deterministic 
approximation of the Gaussian IC with bilateral noisy feedback, i.e., where only some of the 
received bits are fed back to the corresponding transmitter. In P2l . the same authors evaluated 
the bounds for the symmetric Gaussian noise channel and proved that they are at most 11.7 bits 
far from one another, universally over all channel parameters. The capacity characterization was 
accomplished by proving novel outer bounds on 2 R p + If and R p + 2 If that rely on carefully 
chosen side information random variables tailored to the symmetric Gaussian setting and whose 
generalization to non-symmetric or non-Gaussian scenarios does not appear straightforward. 

In this work we first provide a general framework to derive outer bounds of the type 2 R p + If 
and R p + 21 f for the ISD CCIC, which recover as special cases those derived in POl . PT1 . 
We then show that these novel outer bounds are active for the symmetric GCCIC in weak 


March 26, 2015 


DRAFT 


6 


interference when the cooperation link is weaker than the direct link, i.e., in this regime unilateral 
cooperation does not enable sufficient coordination among the sources for full utilization of the 
channel resources. 

3) Non-causal CIC: In the original cognitive radio overlay paradigm, first introduced in 0, 
the superior capabilities of the CTx were modeled by assuming that the CTx a priori knows the 
PTx’s message. The largest known achievable rate region for the general memoryless non-causal 
CIC is lf23l Theorem 7], which in ll24l was evaluated for the Gaussian noise case and shown to be 
at most 1 bit apart (see [f24l Theorem VI. 1]) from an outer bound region, which is characterized 
by constraints on the single rates R p and R c and on the sum-rate R p + R c . In other words, the 
capacity region of the non-causal CIC does not have bounds on 2R p + R c and R P + 2R C , i.e., the 
assumption of full a priori knowledge of the PTx’s message at the CTx allows to fully exploit 
the available system resources. 

In IfTTl . we removed the ideal non-causal message knowledge assumption by considering the 
CCIC and we identified the set of parameters where unilateral cooperation attains the ultimate 
performance limits (i.e., generalized Degrees of Freedom (gDoF)) predicted by the non-causal 
model. In this work we show that the capacity of the CCIC differs in general from that of the 
ideal non-causal CIC since its capacity region has bounds of the type 2 R p + R c and R p + 2 R c , 
i.e., in general removing the ideal full a priori message knowledge at the CTx leaves some 
‘resource holes’ in the system. 

B. Contributions 

Our main contributions can be summarized as follows: 

1) We develop a general framework to derive outer bounds of the type 2 R p + R c and R P + 2R C 
on the capacity of the general ISD CCIC when the noises at the different source-destination 
pairs are independent; this framework includes for example feedback from the intended 
destination. As a special case, we recover and strengthen the bounds derived in @, lf20l . 
EE The key technical ingredient is the proof of two novel Markov chains. 

2) We design a transmission strategy for the general memoryless CCIC and we derive its 
achievable rate region. The proposed scheme uses superposition and binning encoding, 
partial-decode-and-forward relaying and simultaneous decoding at the receivers. Since the 
CCIC shares common features with the classical non-cooperative IC ll25l . both common 
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(decoded also at the non-intended receiver) and private (treated as noise at the non-intended 
receiver) messages are used. Moreover, we use both cooperative (first partially decoded, then 
re-encoded and finally forwarded by the CTx) and non-cooperative (sent without the help of 
the CTx) messages for the PTx, while the messages of the CTx are only non-cooperative. 

3) We evaluate the outer bound and the achievable rate regions for the practically relevant 
Gaussian noise channel. We prove that for the symmetric case, i.e., when the two direct 
links and the two cross / interfering links are of the same strength, the achievable region is a 
constant (uniformly over all channel gains) number of bits apart from the outer bound region 
in the regimes that were left open in ifTTIl . i.e., weak interference and weak cooperation. 
This result, jointly with [fT7L Theorem 1], fully characterizes the capacity of the symmetric 
GCCIC to within a constant gap. Moreover, this result sheds light on the regimes where 
unilateral cooperation is too weak and leaves some system resources underutilized. 


C. Paper organization 

The rest of the paper is organized as follows. Section [E] describes the general memoryless 
CCIC, the ISD CCIC and the Gaussian CCIC, for which the concepts of capacity to within a 


constant gap and gDoF are defined. Section III is dedicated to the outer bounds. In Section III-A 


we first summarize known outer bounds and then generalize and tighten the sum-rate bound 
in [0 bound u\ J by proving two novel Markov chains for the involved random variables. Then, 
Section |III-B derives outer bounds of the type 2 R p + R c and R v + 2 R c for the ISD CCIC with 


independent noises at the different source-destination pairs. Section IV focuses on the Gaussian 
noise CCIC and shows that the two novel outer bounds suffice to prove a constant gap result 
for the symmetric case in weak interference when the cooperation link is not ‘strong enough’, 
i.e., the regime which was left open in [ITTtt . In particular, in Section IV- A| the outer bounds 


are evaluated for the GCCIC, in Section IV-B a novel transmission strategy is designed and its 


achievable rate region is derived and finally in Section IV-C the achievable rate region is shown 
to be a constant number of bits apart from the outer bound region. Section [V] concludes the 
paper. Some proofs may be found in Appendix. 

Although this paper considers only the symmetric Gaussian noise CCIC, we believe that the 
results can be extended to the general non-symmetric case albeit with more tedious and involved 
computations, especially for the achievable region, than those reported here. 
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Fig. 1. The general memoryless CCIC. 


D. Notation 

Throughout the paper we adopt the following notation convention. The subscript c (in sans 
serif font) is used for quantities related to the cognitive pair, while the subscript p (in sans serif 
font) for those related to the primary pair. The subscript f or F (in sans serif font) is used to refer 
to generalized feedback information received at the CTx. The subscript c (in roman font) is used 
to denote both common and cooperative messages, the subscript p (in roman font) to denote 
private messages and the subscript n (in roman font) to denote non-cooperative messages. With 
[n i : n 2 \ we denote the set of integers from ri\ to n 2 > n i and [x] + := max{0, x} for x E M; 
Yi is a vector of length j with components (lj ,... ,Yj) and E [■] indicates the expected value; 
a* denotes the complex conjugate of a and |a| is the absolute value of a; 0 is the empty set. 
The notation eq(n) is used to indicate the rightmost side of the equation number n. 

II. System Model 

A. The general memoryless channel 

A general memoryless CCIC, shown in Fig. [TJ consists of two input alphabets (X p . X c ), three 
output alphabets (34x, y p , 34) and a memoryless transition probability Py Fc ,y p ,y c \x p ,x c - The PTx 
has a message W p E [1 : 2 NRp ] for the PRx and the CTx has a message W c E [1 : 2 NRc ] for the 
CRx, where N E N denotes the codeword length and R v E M + and R c E M+ the transmission 
rates for the PTx and the CTx, respectively, in bits per channel use (logarithms are in base 2). 
The messages W p and W c are independent and uniformly distributed on their respective domains. 
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Fig. 2. The ISD CCIC. 

At time i, i e [1 : N], the PTx maps its message W p into a channel input symbol X pi (Wp) and 
the CTx maps its message W c and its past channel observations into a channel input symbol 
X C i(W c , Y p ~ l ). At time N, the PRx outputs an estimate of its intended message based on all its 
channel observations as W P (Y P N ), and similarly the CRx outputs W C (Y C N ). The capacity region is 
the convex closure of all non-negative rate pairs ( R p , R c ) such that max, ;G { cp j. F[W U ^ W u \ —> 0 
as N —> +oo. 

B. The ISD channel 

The ISD model, shown in Fig. [2] and first introduced in If26il for the classical IC, assumes that 
the input X p , respectively X c , before reaching the destinations, is passed through a memoryless 
channel to obtain T p , respectively T c . The channel outputs are therefore given by 

Y p = f P (X p , T c ) , (la) 

Y c = / c (X c , T p ), (lb) 

where f u , u e {p. c}, is a deterministic function that is invertible given X u , or in other words, 
T p , respectively T c , is a deterministic function of (Y c . X c ), respectively (V p . A" p ). 

In the CCIC, the generalized feedback signal at the CTx satisfies 

Y Fc = f f (X c ,T f ), (lc) 
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Fig. 3. The GCCIC. 

for some deterministic function / f that is invertible given X c , i.e., T f is a deterministic function 
of (Yfc^c), where T f is obtained by passing X p through a noisy channel |[6). 

In this work we assume that the noises seen by the different source-destination pairs are 
independent, that is, 


Py Fc ,Yp,y c |x p ,x c - p yp|x p ,.Y c IPyFc,Tc|x p ,x c - 


( 2 ) 


In other words, we assume that the noises at the PRx and at the CRx are independent, but we do 
not impose any constraint on the noises at the CTx and CRx. For example, the case of output 
feedback in [20| model-(lOOO)] is obtained by setting T f = T p , which would not have been 
possible within the ‘all noises are independent’ setting studied in [0. 

C. The Gaussian noise channel 

A single-antenna GCCIC, shown in Fig. [3j is a special case of the ISD model described in 
(|Tj) and it is defined by the input / output relationship 


T p := y/T p j 0 >X p + Z c , 
T c := VV C ^X C + Z p , 


(3b) 


(3a) 
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(3c) 

Yp = y/Spfp + T c , 

(3d) 

Y c = T P + y/VG, 

(3e) 

E Fc = Tf, 

(3f) 


where Tf = Y Fc in ( |3f| ) is without loss of generality since the CTx can remove the contribution 
of its transmit signal X c from its received signal Y Fc . The channel gains are assumed to be 
constant for the whole transmission duration, and hence known to all nodes. Without loss of 
generality, certain channel gains can be taken to be real-valued and non-negative since a node 
can compensate for the phase of one of its channel gains. The channel inputs are subject to a 
unitary average power constraint, i.e., E [|X,| 2 ] < l,j 6 {p, c}. This assumption is without loss 
of generality, since non-unitary power constraints can be incorporated into the channel gains. 
The noises are circularly symmetric Gaussian random variables with, without loss of generality, 
zero mean and unitary variance. We assume that the noise Z p is independent of (Z c . Z{), while 
(Z c , Zf ) can be arbitrarily correlated. 

For the Gaussian noise case, it is customary to approximate the channel capacity as follows. 

Definition 1 (Capacity region to within a constant gap) The capacity region of the GCCIC 

is said to be known to within GAP bits if one can show an inner bound region X and an outer 
bound region O such that 

{R p , R c )eO => ({R p - GAP] + , [R c - GAP]+) e X. 

For the two particular cases of C = 0 (i.e., non-cooperative IC) and of C —* +oo (non-causal 
CIC), the capacity is known to within 1 bit [|T8l , |[24l . 

The approximate (i.e., to within a constant gap) characterization of the capacity region implies 
the exact knowledge of its gDoF region. The gDoF metric, first introduced in [|T8l for the non- 
cooperative IC, captures the high-SNR behavior of the capacity as a function of the relative 
strengths of the direct, cooperation and interfering links. The gDoF represents a more refined 
characterization of the capacity in the high-SNR regime compared to the classical DoF since 
it captures the fact that, in wireless networks, the channel gains can differ by several orders of 
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magnitude. In this work, we consider the symmetric case parameterized as 


S p = S c := S\ 

S > 0, direct links, 

(4a) 

l P = lc := S“, 

a > 0, interfering links, 

(4b) 

C := S' 3 , 

(3 > 0, cooperation link, 

(4c) 


where a measures the strength of the interference links compared to the direct link, while [3 
the strength of the cooperation link compared to the direct link. Thus, the symmetric GCCIC is 
parameterized by the triplet (S,a,/3), where S is referred to as the (direct link) SNR, a as the 
interference exponent and (3 as the cooperation exponent^ 


Definition 2 (gDoF) Given the parameterization in ©. the gDoF is defined as 

max{f? p + R c } 

d (a,B):= lim - - -— 

S-s>+oo 21og(l + S) 

where the maximization is intended over all possible achievable rate pairs ( R p , R c ). 


(5) 


The gDoF of the classical IC (C = 0) is the “W-curve” first characterized in llT8l and given 
by d(a, 0). The gDoF of the non-causal CIC (C —» oo) is the “V-curve”, which can be evaluated 
from the capacity characterization to within 1 bit of ll24l . and is given by d(o. oo). An interesting 
question this work answers is whether there are values of j3 > 0 such that d (a, (3) = d(a, 0) 
— in which case unilateral causal cooperation is not helpful in terms of gDoF — or values of 
f3 < oo such that d(a, /3) = d(a, oo) — in which case unilateral causal cooperation is equivalent 
to non-causal message knowledge in terms of gDoF. 

Following the naming convention of the non-cooperative IC [fT8l . we say that the symmetric 
GCCIC has strong interference if S < I, that is 1 < a, and weak interference otherwise. Similarly, 
we say that the symmetric GCCIC has strong cooperation if S < C, that is 1 < f3, and weak 
cooperation otherwise. 


'in principle the system performance also depends on the phases of the interfering links ( 6 C , 0 P ). However, as far as gDoF and 


capacity to within a constant gap are concerned, the phases (6 C , 0 P ) only matter if the IC channel matrix 


ys; Cl c e j 


jflc 


V^p 1 


e j0p 


y/s; 


is rank deficient m, in which case one received signal is a noisier version of the other. In this work, we assume that the phases 
are such that the IC channel matrix is full rank as in m. 
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III. Outer bounds on the capacity region for the CCIC 
This section is dedicated to the study of outer bounds on the capacity region for the CCIC. 


First, in Section |III-A[ some known outer bounds are summarized. Moreover, the outer bound 
originally derived in [j6l for the ISD CCIC with independent noises at all terminals, is generalized 
to the case where only the noises at the different source-destination pairs are independent as 
in ([2]). Then, in Section |III-B[ two novel outer bounds of the type R p + 2 R c and 2 R p + R c are 
derived for the ISD CCIC with independent noises at the different source-destination pairs as 
in Q. As we shall see in Section |IVj these novel outer bounds allow to characterize the capacity 
to within a constant gap for the symmetric GCCIC in the regimes that were left open in [H71 . 


A. Known outer bounds and some generalizations 

In the literature, several outer bounds are known for the IC with bilateral source coopera¬ 
tion 0,(61, which we specialize here to the CCIC. In particular, for a joint input distribution 

P* P! x c , we have: 


1) For the general memoryless CCIC, described in Section II-A the cut-set upper bound 
gives 


Rp < I {Xp-Y p ,Yp c \X c ), 

(6a) 

Rp<I(Xp,X c -Y p ), 

(6b) 

R c <I{X c -Y c \Xp), 

(6c) 


and from 


we have 

R P 

R n 


R C <I (X p ; Y p , Y fc \Y c , X c ) + I (X p , X c ; Y c ), 
Rc<I (X c - Y c \Y p , X p ) + I (X p , X c - Y p ). 


(6d) 

(6e) 


Notice that in the bounds in (|6a[)-(|6e|), Yp c always appears conditioned on X c . This implies 
that, for the ISD channel described in Section II-B| Yf c can be replaced with Tf without 
loss of generality. 


2) For the memoryless ISD CCIC, described in Section II-B with independent noises at the 
different source-destination pairs as in ([2]), we have 


Rp + Rc <1 {Yp-, Xp, X c \Tp, T f ) + I (Y c , Tf, Xp, X C \T C ) 


(6f) 
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The details of the proof of the bound in ( f6f[ ) can be found in Appendix [B] 

We note that a bound as the one in ([6^) was originally derived in [[6l Appendix IV pages 
177-179] for the ISD IC with bilateral source cooperation when all noises are independent; 
for the case of unilateral source cooperation, this follows from the following Markov chain 


(Wp, Ay) - (TV- 1 ) - (W c , X c \ TV), Vi G [1 : TV], (7a) 

(We, XV) - (TV- 1 ) - (Wp, Ay, TV), Vi G [1 : TV]. (7b) 


A careful analysis of the bounding steps in 0 Appendix IV pages 177-179] shows that 
the derivation of the bound in ([61]) is valid even when Py Fc ,y Ci y p |x p ,x c factors as in ([2]), i.e., 
the independent noises assumption at all terminals captured by the product distribution 
p >fcVcVpApAc = p v Fc | -Yp , A' c p y c | x p ,x c p y p |x p ,x c is not necessary for the bound to hold by 
suitably modifying the Markov chains in ([7]) — see Lemma [T| Among the advantages 
of the bound in ( |6f| ) is that the case of output feedback from the intended destination is a 
special case of the more general framework and can be obtained by Yf C = Y c . 

We note that our bound in ([61]) is not only more general but also tighter than the one in j6] 
Appendix IV pages 177-179] since / (T f ; X p , A C |T C ) < / (T f ; X p ) and H (Y p \T p ,Tf) < 
H (Y- P |T P ). 


The key step of the proof for the bound in (6f) is the following Lemma: 


Lemma 1 For the ISD CCIC with the noise structure in ([2]), the following Markov chains 
hold for all i G [1 : TV]: 

(W pi Tf-\x;) - (TV 1 , TV 1 ) - (TV, (8a) 

(IVVV 1 , Xf) - (TV 1 , TV 1 ) - (T Pi , Tfj). (8b) 


Proof: The proof is based on the Functional Dependence Graph (FDG) ll28l and can 
be found in Appendix [A] ■ 

3) For the memoryless ISD IC with output feedback Y Fc = Y c in ([2]), from [20, model-(lOOO)] 
we have 

R P + 2Rc <1 V; X p , X c ) + I (Y c - X c |V p , X p ) + I (V p ; X p , X c |T p ). (9) 
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To the best of our knowledge, the bound in ([9]) is the only upper bound of the type R P + 2R C 
available in the literature for the cooperative IC (which includes feedback models as a special 
case), but it is only valid for the case of output feedback. Our goal in the next section is 


with independent noises at the different source-destination pairs as in ([2]). 


to derive bounds of the type of Q for the class of ISD CCICs described in Section II-B 


B. Novel outer bounds 

In this section we derive two novel outer bounds of the type R p + 2 R c and 2 R p + R c on 


the capacity region for the ISD CCIC described in Section II-B with independent noises at the 
different source-destination pairs as in Q. These two outer bounds generalize to the CCIC those 
of the same type in [26] Theorem 1], derived for the classical non-cooperative IC. 

Our main result in this section is as follows. 


Theorem 1 For the ISD CCIC satisfying the condition in ([2]), the capacity region is outer 
bounded by 


2 R P + R C <I (Y p] X p , X c ) + I (Y p ; X p \Tf, Y c , X c ) + I {Y c , T f ; X p , X c \T c ), 
R p + 2 R C <I (Y c - X p , X c ) + I (Y c - X c \T f , Y p , X p ) + I (Y p , T f ; X p , X C |T P ). 


( 10 ) 

(ID 


for some joint input distribution Px p ,x c - 


Note that, when evaluated for the case of output feedback with independent noises, i.e., Tf = 
T p , the outer bound in ( fTT| ) reduces to the one in <(9]). 

Proof: By Fano’s inequality, by considering that the messages W p and W c are independent 
and by giving side information similarly to |6|, we have 

N(2R p + R c — 3 €]\r) 

<21 (W p ;Y p n )+I(W c ;Y c n ) 

< I (W p , Y p N ) + I (W p ; Y P N , T p N , T f N \W c ) + I (W c ; Y C N , T C N , T f N ) 


= H (Y p N ) - H (Yp A \ T P N , T f N \W p , W c ) 

(12a) 

+ H ( Y p N ,T p N ,T f N \W c ) - H (Y c N ,T c N ,T f N \W c ) 

(12b) 

+ H (Y c n , T c n , T f N ) - H (Y p N \W p ) . 

(12c) 


We now analyze and bound each pair of terms. 


March 26, 2015 


DRAFT 




16 


Pair in (12a); We have 


(a) 


H(Y p N )-H(Y p N ,T p N ,T f N \W p ,W c ) 

Y H (FpJV 1 ) - H (Y Pi ,T Pi ,T fi \W p , W^Y/- 1 , V~\Tr\X p \Xj) 

ie[l:AT] 


(b) v _ 

< Y H ( y p*) - H ( y pp V" 1 , v~\rr\ v, xj) 

ie[l:JV] 

i£[l:N] 

where: the equality in (a) follows by applying the chain rule of the entropy and since, for the 
ISD CCIC, the encoding function X ci (W c , Y^~ 1 ) is equivalent to X CI {W C , Tf*” 1 ) and since, given 
W p , X p is uniquely determined; the inequality in (b) is due to the conditioning reduces entropy 
principle; the equality in (c) follows because of the ISD property of the channel and since the 
channel is memoryless. 


Pair in (12b); We have 


H (Yp N ,T p N ,T f N \W c ) - H (: Y c N ,T c N ,T f N \W c ) 


(d) 

E 

H 

Tpii Tfi 

I y i— 1 

I I P 

rp 2—1 

’ 1 P 

rp 2—1 

,W c ,Xj)-H(Y ci ,T ci , 

TulYj- 

-1 rp i— 

1 1 c 

1 rp i — 

5 4 

-\w c ,xj) 


ie[l:AT] 











(e) 

E 

H 

Tpii Tfi 

Iv i —1 
1 1 P 

rp 2—1 
5 1 P 

rp 2—1 
5 4 

j W c , X c *) — H (T PV T ci , 

Tu\V 

— 1 rp i- 

5 c 

-1 rp 2- 

5 4 

~\w c ,xj) 


ze [1:2V] 











(0 

< 

E 

H 

V 

{TpvTulTj- 

-1 rp i 

i-Lf 

~\w c 

, AT) 

1 

i 

T' 

1 rp 2—1 

? 4 

,w c ,xj) 



= 0 because of {8bJ 


+ Y H(Y Pi \T Pi ,T H ,X ci )-H(T ci \Tp\T c i -\T f i ,W c ,X c i ,X p i ) 

i£[l:N] 

= E H { Y Pi\ T Pf T fi, x a) - H (Y n \T ri ,T„,X a ,X K ) , 

i£[l:N] 

where: the equality in (d) follows by applying the chain rule of the entropy and since, for the 
ISD CCIC, the encoding function X ci (W c , Y p ~ 1 ) is equivalent to X ci (W c , the equality in 

(e) is due to the fact that Y c is a deterministic function of (X c ,T p ), which is invertible given 
X c ; the inequality in (f) is due to the conditioning reduces entropy principle; the equality in (g) 
follows because of the ISD property of the channel and since the channel is memoryless. 
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Pair in (12c); We have 


H (Y«\W r ) 

= E H(Y K \Y f '-\W f ,X r ') 

ie[l:AT] 

ie[l:JV] 

> H (T ci |T c <_1 , Wp, A^, Tf <_1 ) 

ie[l:AT] 

= ^ H {T ci \Tr\ Tt 1 ) - I (T ci - Wp, AVI TT\ TT% 

ie[l.A r ] _ Q ^ ecause jgjj 

where: the equality in (h) follows by applying the chain rule of the entropy and since, given W p , 
X p is uniquely determined; the equality in (i) is due to the fact that Y p is a deterministic function 
of (A'p, T c ), which is invertible given A" p ; the inequality in (j) follows since conditioning reduces 
the entropy; the equality in (k) follows from the definition of mutual information. Therefore, 


H (Y c n , T c n , T f N ) - H (Y p N \Wp) 


(i) 


< H (Yci, T ci, T n\Yc i -\T c i - 1 ,T f i - 1 ) ~ H {T^Tt 1 ^- 1 ) 


iG[l:N] 


(m) 

< ^ H {T ci \Tt\Tt 1 ) - H {T ci \Tr\Tr 1 ) + H {Y ci ,T H \Yt\T c \Tr 1 ) 

»e[l:N] 

< ^ 0 + H(Y ci ,T fi ,\T ci ), 

i£[l:N] 

where the inequality in (1) is a consequence of the inequality in (k) above and the inequalities 
in (m) and (n) are due to the conditioning reduces entropy principle. 

Final step: By combining everything together, by introducing the time sharing random 
variable uniformly distributed over [1 : N] and independent of everything else, by dividing both 
sides by N and taking the limit for iV -> oo we get the bound in ([TO]). We finally notice that by 
dropping the time sharing we do not decrease the bound. Note also that, since for the ISD model 
defined in (|T|) T p , respectively T c , is a deterministic function of (Y C ,X C ), respectively (Yp, A p ), 
we have H (T p , T f \Y p , X p , X c ) = H (Y c , T f |T c , A p , A c ). 

By following similar steps as in the derivation of (fTO]) and by using the Markov chains in (f8a|) 
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Fig. 4. Gap for different parameter regimes for the symmetric GCCIC. 


and ( |8b| ), one can derive the upper bound in ( [IT] ). For completeness, we report the proof of ( fTT] ) 
in Appendix [Cj ■ 

In the next section we will evaluate the outer bounds in (|6]) and those in Theorem |T] for the 


Gaussian noise channel described in Section II-C and show that they allow to characterize the 
capacity to within a constant gap in the regimes which were left open in |[T7|. 


IV. The capacity region to within a constant gap for the symmetric GCCIC 


In this section we analyze the practically relevant Gaussian noise channel described in Section 


Theorem 1], we proved a constant gap of 1 bit in the strong interference regime, i.e., I > S 
(equivalent to a > 1), and in the weak interference regime, i.e., I < S (equivalent to a < 1) 
when the cooperation link is ‘sufficiently strong’ as quantified by C > A t h with 


II-C In particular, we focus on the symmetric case defined in Q. For such a scenario, in 11171 


Ath : — 


+ 2 




(1 + 1), (equivalent to (3 > a + 1). 


(13) 
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The regimes for which we proved the constant gap result of 1 bit in liTTl Theorem 1] are depicted 
in blue in Fig.[4j where the whole set of parameters has been partitioned into multiple sub-regions 
depending upon different levels of cooperation ((3) and interference (a) strengths. 

Therefore, the case of weak interference (a < 1) and weak cooperation ((3 < a + 1) (i.e., 
yellow, red and green regions in Fig. [4]) was left open in [fT71 . where we speculated that for 
this regime, novel outer bounds of the type 2 R p + R c and R p + 2 R c would be needed since, 
when the cooperation link is not ‘sufficiently strong’, the performance of the GCCIC should 
reduce to the classical non-cooperative IC, whose capacity has bounds of the type 2 R p + R c and 
R p + 2 R c IH81 . With the two novel outer bounds in Theorem [T] we can prove the main result of 
this section: 


Theorem 2 The capacity region outer bound for the symmetric GCCIC in weak interference, 
i.e., I < S, is achievable to within a constant gap. In particular: 

1) C < S (i.e., /3 < 1 ), which corresponds to the green and red regions in Fig. |4j - GAP < 5 bits. 

2) S < C < A ,h (i.e., 1 < (3 < 1 + a) for A,/, in ( [T3] ), which corresponds to the yellow region 
in Fig. [?]' GAP < 2 bits. 

3) For the remaining parameter regimes, which correspond to the blue region in Fig. [?}■ GAP < 
1 bits ftTTll . 


Theorem [2] and |U71 Theorem 1] characterize the whole capacity region for the symmetric 
GCCIC to within 5 bits. The rest of this section is dedicated to the proof of Theorem |2j In 
particular, in Section IV-A we evaluate the outer bounds in ([6]) and those in Theorem |T] for 


the symmetric GCCIC, in Section IV-B we derive a novel achievable rate region and finally in 


Section IV-C we show that the achievable rate region is a constant number of bits apart from 
the outer bound region. 


A. Outer bound region 

We evaluate the bounds in ([6]), ( [TO] ) and ( [TT| ) for the Gaussian noise channel in ([3]). We 
define E [X p X c *] := p : \p\ e [0,1]. We also assume that all the noises are independent, which 
represents a particular case for which our outer bounds hold. By the ‘Gaussian maximizes 
entropy’ principle, jointly Gaussian inputs exhaust the outer bounds in <(6]), ( |T(j| ) and ( [IT] ). Thus, 
we start by evaluating each mutual information term in ([6]), ( [TO] ) and ( |TT[ ) by using jointly 
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Gaussian inputs. Then, we further upper bound each mutual information term over the input 
correlation coefficient p : \p\ e [0,1]. By doing so we obtain: 


Lemma 2 The capacity region of the symmetric GCCIC is contained into 
R p ^ log (1 + C + S), 


R P < log ( 1 + (VS + V\ 


R-c < log (1 + S), 

R p + R c < log ^1 + —+ log ( 1 + ( Vs + V\ 

s + c 

1 + 1 


Rp + f? c < log ( 1 + 


log ( 1 + ( Vs + V\ 


>eqjl4d} 


Rp + R c < log ( 1 + C + I 


1 + 1 


+ log 1 + I + S 


1 + C 

l + c + l 


+2 log(2), 


> log(l+2l+ I | 1 )+log(l+l+!)>eq(T4d}-21og(2) 


2R P + R c < log (1 + v/S + a/T) ] + log (1 + -——- ) +Ap 4 ^ + log(2), 


1 + 1 


i-rate bound in (JTTdJ 


l + l + s 


Rp + 2 R c < log ^ 1 + (^S + j + log ^ 


v 1 + i + 


l + l + C 

s 


+A/T 4 i) + log(2), 


sum-rate bound in < fl4d) 

5 \ for C>S 

A(T 4 i) := log ( 1 + C + I + > log(l + S). 


(14a) 

(14b) 

(14c) 

(14d) 

(14e) 

(14f) 

(14g) 


c \ { 1 + C \ for C>l / S' 

A{T4|} := log I 1+ , , , , r ) +log ( 1 + I + s , , , — ) > log (1 + 1 + 77 ) > (!4h) 


(14i) 


(14j) 


Proof: The outer bound region for the general GCCIC is given in ( f25| ) in Appendix |D] that, 
specialized to the symmetric case, gives the region in ( [T4| ). 

We note that the outer bound expressions in ([T4]) are slightly different from those reported in 
Cl eq.(l)] and |2] eq.(6)] because of different bounding steps over the input correlation factor 
p, \p\ e [0,1]; the form presented in ( [T4| ), although not being the tightest, is in our opinion the 
most amenable for easy closed-form gap computations. ■ 
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The following discussion applies ‘up to a constant gap’, that is, by excluding terms that are 


not a function of the channel gains. In weak interference the bound in (14a) can be dropped 


since the condition I < S in d 14b| ) implies R p < log (1 + S) + 2 log(2). The bound in ( |14e| ) can 
also be dropped because it is looser than the one in ([T4d]). These observations imply that in the 


weak interference regime only the ‘ISD bounds’ in ( | 1 4f| )-( [T4l1 ) depend on the strength of the 
cooperation link C. The channel conditions for which the whole outer bound in ( [T4| ) does not 
depend on C can be characterized as follows: 

1) C > max{S, I}: when the outer bound in f fT4] ) is an outer bound for the non-causal Gaussian 


CIC. The bounds in (|14g[) and (|14i|) are redundant when C > max{S, I}. Moreover, for 


C > I the sum-rate in (14f) is looser than the one in (14d). We therefore conclude that for 


C > max{S, 1} the outer bound in ( [T4| ) does not depend on C and reduces to the region 


R P < log ( 1 + (VS + VT 


Rc < log (1 + S), 

R 


Rc < log ( 1 + J + log y 1 + (^ Vs + V\ 


(15a) 

(15b) 

(15c) 


which is an outer bound on the capacity region of the non-causal Gaussian CIC (see [j24l 
Theorem III. 1]). Thus, our outer bound predicts that, when C > max{S, 1} (yellow and part 
of the blue regions in Fig. [4]), the symmetric GCCIC should behave, up to constant gap, as 


the symmetric non-causal Gaussian CIC; in Section IV-C3 we will formally prove this for 
the yellow regime in Fig. [4| i.e., for I < S < C < A th with A th defined in ( fT3j ) (the blue 
regimes in Fig. [4j i.e., S < I and S > I with C > A th , were proved in ifTTIl ). 

2) C < min js, i +s } : w h en the outer bound in 0 is an outer bound for the classical 
Gaussian IC. In lU71l . we proved this behavior in strong interference (i.e., S < I), in 
which case we have min js, '(V j = S. On the other hand, in weak interference we 
have min js, 1 (V j — VV which case the condition C < hl±r i m phes C < I and 


l+S 

. 1+c+| < + I; thus, the outer bound in ( [T4| ) reduces to the region 

R P < log(l + S) + 21og(2), 

Rc < log (1 + S), 


Rp + Rc A log (1 + S) + log (1 + 


1 + 1 


+ 2 log(2), 


(16a) 

(16b) 

(16c) 
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R P + R C < log ^1 + I + + log ^1 + I + + 41o §( 2 ) ? ( 16d ) 

2R P + R C < log (1 + S + I) + log + log + I + YT]) + 5 lo g( 2 )> ( 16e ) 

R P + 2R C < log(l + S + I) + log (i±f) + log ^1 + I + Y^Tf) + 41 °g( 2 )’ ( 16f ) 


which is an outer bound on the capacity region of the classical Gaussian IC (see [ T8l 
Theorem 3]). Thus, our outer bound predicts that, when C < min js, j, the symmetric 
GCCIC should behave, up to constant gap, as the non-cooperative Gaussian IC; we will 




formally prove this for the weak interference 
strong interference regime C < S < I was proved in [fI71 ). 


B. Transmission strategy and achievable rate region 

We next design a transmission strategy for the CCIC. In particular, since we aim to derive 
a scheme that is approximately optimal in weak interference, we consider both private and 
common messages for the PTx and the CTx, in the spirit of [|T8ll for the classical IC. Moreover, 
depending on the strength of the cooperation link, the PTx might take advantage of the help 
of the CTx in transmitting its message, i.e., the messages of the PTx are both cooperative and 
non-cooperative. 

In order to enable cooperation, a block Markov coding scheme is used as follows. Transmission 
is over a frame of B 1 slots. In slot t & [1:5], the PTx sends its old (cooperative common and 
private) messages (W pcCtt - i , W ppc ,t -i ) and superposes to them the new (cooperative common and 
private) messages (W pcCit , W ppCjt ) and the new non-cooperative common and private messages 
(WpcnfrWppnj). At the end of slot t, the CTx jointly decodes the new cooperative messages 
(W pcc , t ,W ppCjt ) after subtracting the contribution of the old messages (W pcc ,t-i, Wppc,t-i)- At 
the beginning of slot t G [1 : B\, the CTx knows the PTx’s old private cooperative message 
W ppc j- ] and, depending on the strength of the cooperation link compared to the interference link, 
the CTx might precode both its private and common non-cooperative messages (W ccn . t , W cpn>t ) 
against the known interference, in such a way that the CRx does not experience interference 
from the codewords conveying these messages. The destinations wait until the whole frame has 
been received and then proceed to simultaneous backward decode all messages. 
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The detailed derivation of the achievable rate region can be found in Appendix [E] The achiev¬ 
able rate region in compact form can be obtained by applying the Fourier-Motzkin Elimination 


(FME) procedure on the rate constraints in fl27[ ). Since the rate region in fl27| ) is specified by 8 
auxiliary random variables and by 20 rate constraints, the FME turns out to be quite involved. 
However, depending on the strength of the cooperation link compared to the direct and interfering 
links, the PTx might not use some of the messages, i.e., the corresponding auxiliary random 
variables are set to a deterministic constant. In particular: 

1) When /3 < max {a, 1 — a} (green region in Fig. [4|, the cooperation link is quite weak; 
we therefore expect the CCIC to ‘behave’ as the classical non-cooperative IC ifTSTl for 
which both private and common non-cooperative messages are approximately optimal. 
Differently from the classical IC, the PTx also conveys part of its message through the 
CTx. This cooperative message is common, and thus also decoded at the CRx. Actually, 
since the cooperation link is weak, the amount of information that can be decoded, and 
hence delivered, by the CTx is limited. Thus, there is no need to employ binning, i.e., 
the scheme is based on superposition only. In other words, for this regime, the PTx does 
not make use of the private cooperative message, i.e., with reference to the transmission 
strategy in Appendix [Ej we set Si = Z x = 0. 

2) When max {a, 1 — a} < (3 < 1 (red region in Fig. [4]), the cooperation link is stronger than 
the interfering link, but weaker than the direct link. Thus, on the one hand the PTx takes 
advantage of these channel conditions by using cooperative messages; on the other hand, 
the cooperation link is not strong enough (i.e., weaker than the direct link) to allow the 
CTx to fully decode the PTx’s message, and hence the PTx also uses a non-cooperative 
message. In particular, the non-cooperative message of the PTx is private; this is because 
the interference is too weak and forcing the CRx to fully decode the PTx’s message would 
constrain the rate too much. At the same time, the CTx can also benefit from the strength 
of the cooperation link and boost its rate performance by precoding its message against 
the private cooperative message of the PTx, i.e., the scheme is based both on superposition 
and binning. In other words, for this regime, the PTx does not make use of the common 
non-cooperative message, i.e., with reference to the transmission strategy in Appendix [Ej 
we set (7i = 0. 


March 26, 2015 


DRAFT 




24 


3) When 1 < (3 < a + 1 (yellow region in Fig. [4]), the cooperation link is stronger than both the 
interfering and the direct links. Thus, the PTx takes advantage of the strong cooperation link 
and sends its message to the PRx with the help of the CTx, i.e., the messages of the PTx are 
only cooperative. Moreover, since the interference is weak, the messages of the CTx and of 
the PTx are both common and private. Also for this regime we use binning at the CTx. In 
other words, for this regime, the PTx does not make use of the non-cooperative messages, 
i.e., with reference to the transmission strategy in Appendix |E| we set U\ = T X = 0. 

As per our discussion above, depending on the strength of the cooperation link compared to the 
direct and interfering links, some types of messages are not needed to achieve the outer bound 
to within a constant gap. Thus, instead of performing the FME directly on the rate constraints 
in ( f27j ), we apply the FME for two special cases: when Si = Z x = J (to obtain a scheme for the 
green region in Fig. [4| and when U\ — 0 (to obtain a scheme for the red and yellow regions in 
Fig. [4| for the yellow region we then further set T\ =0). The details can be found in Appendix 
E-A| and Appendix E-B, respectively. In the next section, we will show that the two achievable 


rate regions achieve the outer bound in (fl4]) to within a constant gap. 


Remark 1 Although in this work we focus on the symmetric GCCIC, i.e., the two direct and 
the two interfering links are of the same strength, the derived outer bound and the designed 
transmission strategy are valid for a general GCCIC, which is described by 5 different channel 
gains. Extensions to the general case are part of future work. 

Remark 2 The novelty of the transmission strategy designed in Section \IV-B\ compared to those 
proposed in / 1771/ lies in the fact that the PTx uses cooperative and non-cooperative messages 
together. In particular: (i) the scheme based on superposition coding in Kl7\ Appendix B] used 
U] = 0, i.e., the PTx does not use a non-cooperative common message, while the superposition 
based scheme here proposed has U\ f 0; (ii) the scheme based on binning and superposition 
coding in l\T7\ Appendix C] used U x — T x — 0, i.e., the PTx does not use non-cooperative 
common and private messages, while the scheme here proposed has U\ f 0 and Ti f 0. 


C. Constant gap characterization 

In the following we analyze the green, red and yellow regions in Fig. [4] separately. 
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1) Regime C < max {I. } , I < S (green region in Fig. 4): As remarked in item [I] in 
Section IV-B for this region we set Si = Z\ = 0 in the transmission strategy in Appendix [Ej 
i.e., the PTx does not use private cooperative messages. With this choice and after performing 
the FME, we obtain the rate region in ( [28] ) in Appendix |E-A[ which evaluated for the Gaussian 
noise case gives the region in ( |29| ). In ( |29| ), we set l p = l c = I, S p = S c = S (i.e., we consider 

= t^-t so that the private message of CTx (conveyed 


°2 


the symmetric case) and |6 2 | 2 = 1 
by T 2 ) is received below the noise level at the PRx in the spirit of IfTSTl . Regarding the choice 
of the power splits for the PTx, we further split the green region into two subregions: subregion 
(i) for which C < (i.e., (3 < [2a — 1] + ) and subregion (ii) for which C > (i.e., 

/ 3 > [2a — 1] + ). We now analyze these two subregions separately. 

Subregion (i): when (3 < [2a — 1] + , the cooperation link is very weak and thus we expect the 
GCCIC to behave as the non-cooperative Gaussian IC lfT8l . Therefore, we set the power of the 
cooperative common message (carried by Vi) to |&i| 2 = 0 in ( [29] ) and |ci|- = 1 — |ai| 2 = ^ so 
that the private message of PTx (conveyed by 7)) is received below the noise level at the CRx 
in the spirit of lfl8l . With these choices and by removing the redundant constraints in ([29]) (i.e., 


eq(29a), eq(29e), eq(29f>, eq(29g), eq(29j) and eq(29k)), we get that the achievable rate region 


in (29) is contained into 


jgreen-W . ^ < bg (1 + S) _ l 0 g(2), (17a) 

Rc < log (1 + S) - log(2), (17b) 

R p + R c < log (1 + S + I) + log ^1 + i ^ — 2 log(2), (17c) 

R p + R c < log ^1 + I + + log (l + I + ~ 2 lo §( 2 )> ( 17d ) 


2R p + R C < log ^1 + + log (1 + s + I) + log ^1 + I + - 3 l°g( 2 )> ( 17e ) 

R P + 2i? c < log (l + I + Y^T\) + lo § f 1 + i^Tf) + log (1 + S + I) - 3 log(2). (17f) 

Notice that the rate region in ( [17] ) is the achievable region for the classical symmetric non- 
cooperative IC in weak interference, which is optimal up to a gap of 1 bit/user [|T8l . 

For this regime, the outer bound in ([T4]) can be further upper bounded (by removing the 
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constraints in (14b) and (14el) as 


0 green- (i ) ; ^ < l og (1 + S) + log(2), 


Rc < log (1 + S), 

R P + Rc + log (1 + 


1 + 1 


0 <c<l 


Rp + R c < log I 1 + 


r< Ki+O 
— l+S 


< log 1 + 


+ log (1 + S + I) + log(2), 

J_) + iog ( 1 + i + s++ 
s \ . s 


(18a) 

(18b) 

(18c) 


l + l/ +l0g l 1 + l+ l + l 


+ 3 log(2) 
+ 41og(2), 


(18d) 


0<C<l / S \ / 1 4- f'l 

2R p + R c < log (1 + S + I) + log ( 1 + -—■—- ) + log ( 1 + I + S — —■—— ) + 3 log(2) 


1 + 1 


c< 


1 ( 1+0 


< log (1 + S + I) + log ( 1 + —) + log ( 1 + I + ~ — t ) + 41og(2), 


1 + 1 

S 


l + iy °V l + l 


o<c<i / s \ / s 

R P + 2R C < log(1 + S + I) + log f 1 + Y+~\ ) + I 0 ® ( 1 + I + ~i+~\ 


(18e) 


+ 3 log(2). 


(1810 


It is easy to see that the outer bound region in ( fl8| ) and the achievable rate region in ( fT7| ) are 
to within 3 bits/user of one another. Notice that in order to prove a constant gap we compared: 
eq( |17a[ ) with eq( |18a[ ), eq( | 17b| ) with eq( |18b[ ), eq( |17c[ ) with eq( |18c[ ), eq( |17d[ ) with eq( |18d[ ), eq( |17e| ) 
with eq( |18e| ), and cq( | 171] ) with cq( ] 1 8f[ ). 

Subregion (ii): when B > [2a — 1] + , the GCCIC starts to benefit from cooperation and indeed 
the outer bound region depends on C. Therefore the cooperative common message carried by 


V\ can boost the rate performance of the system. In fl29| ), we set the power of the common 
non-cooperative message (carried by Ui) to |ai| 2 = | |[M I || , C ,,. ■ This choice is motivated by 

the fact that, in order to approximately match the outer bound, the single rate constraint on R p 


in ( |29b| ) must approximately behave as an interference-free point-to-point channel. Therefore, 
the fact that the CTx can now decode part of the message of the PTx (carried by V)) must not 
limit (up to a constant gap) the performance of the PTx. In other words, since C is ‘quite large’ 


but not ‘huge’, the rate of V\ cannot be too large. Moreover, we set |ci | 2 = 


i 


2 ( 1 + 1 ) 


so that the 


private message of PTx (conveyed by 7)) is received below the noise level at the CRx in the 
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spirit of [18]. Thus, if I < C we have |6i| 2 = t^-t, while if I > C we have |&i| 2 = C+I+2CI 


With these choices and by removing the redundant constraints in 


2 ( 1 +C)( 1 +I)' 

(i.e., eq( |29a[ ), eq( |29d[ ), 


eq(29f), eq(29g), and eq(291)), we get that the achievable rate region in (29) is contained into 


jgi- 


een-(ii) . 


Rn 


Rp < log(l + S) - 41og(2), 

Rc < log(l + S) - log(2), 

R c < log (l + S +1) + log - 3 i°g( 2 ), 


Rp + R c < log ( 1 + I 


1 + 1 


+ log 1 + 


1 + 1 


+ log (1 + min {I, C}) - 5 log(2), 


2Rp + R c < 2 log ( 1 + 


+ log (1 + S + I) 


1 + 1, 

+ log (1 + min{l, C}) - 61og(2), 


2Rp + R c < 2 log ( 1 + 


Rn 


1 + 1 


+ log 1 + I + 


1 + minjl, C} 


2 log (1 + minjl, C}) — 9 log(2), 


2 R c < log (1 + I 
+ log (1 + 


+ 


log (l 


1 + 1/ V 
S + l) -41og(2). 


+ 


1 + 1 


(19a) 

(19b) 

(19c) 


(19d) 


(19e) 


(19f) 


(19g) 


For this regime, the outer bound in (fl4]) can be further upper bounded (by removing the 


constraints in (14b) and (14e)) as 


Qgreen-(ii) . < bg (1 + S) + log(2), (20a) 

Rc < log (1 + S), (20b) 

R p + R c < log (1 + S + I) + log ^1 + i ^ + log(2), (20c) 

0 <C<max{l lT ^} / S \ 

r p + -Rc < log (i +1 + m / 

+ log (l + I + ^ | 4 f C ^ + 3 log(2), (20d) 

o<c<s / S \ 


2R P + R c < log ^1 + J + log (1 + S + I) 
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+ log ( 1 + I + 5 — + ^ ) + 3 log(2), 


R p + 2 i? c 


1 + C T 

0<C<max|l, j- / g 

< log(^l + l + — 

+ log (1 + S + I) + 31og(2). 


(20e) 


+ log 1 + 


1 + 1 


(200 


It is easy to see that the outer bound region in { [20] ) and the achievable rate region in ([T9]) are 
to within 5 bits/user of one another. Notice that in order to prove a constant gap we compared: 
eq( |19a| ) with eq( |20a| ), eq( |19b[ ) with eq( |20b[ ), eq( |19c| ) with eq( |20c[ ), eq( |19d[ ) with eq( |20d[ ), eq( |19e| ) 
with eq( |20e| ), eq( |19f| ) with cq P0c[ ), and eq( |19g[ ) with cq( j2()f| ). 

2 ) Regime max { '.+}< C < S (red region in Fig. |+J)/ As remarked in item [ 2 ] in Section 
IV-B for this region we set U\ = 0 in the transmission strategy in Appendix [Ej i.e., the PTx 


does not use a common non-cooperative message. With this choice and after performing the 
FME, we obtain the rate region in 


in Appendix E-B, which evaluated for the Gaussian 
noise case gives the region in ]3T] ). For l p = l c = I and S p = S c = S, we set |a 2 | = 0, and 
|c 2 | 2 = 1 — | b 2 1 2 = -j-’-f in the region in ( |3Tj ). With this choice the private message of the CTx 
(conveyed by T 2 ) is received below the noise level at the PRx in the spirit of jl8l . Note also that 
the CTx does not cooperate with the PTx in conveying information to the PRx, but it just exploits 
the information it leams through the cooperation link to smartly pre-encode its messages. For 
the PTx we let |ai| 2 = l^l 2 = 4( '+_^ 2l ) c c) , |ci| 2 = and |dx| 2 = 2(1 1 fC) ; with this choice 

of the power splits and since we are in the regime C > I, the two private messages of the PTx 
(i.e., the cooperative one carried by Z\ and the non-cooperative one carried by 7\) are received 
at most at the level of the noise at the CRx. Moreover, the non-cooperative private message 
(carried by Tj) is received at the level of the noise at the CTx. 

With these choices we get that the achievable rate region in ( f3T| ) is contained into (by 
considering min {k u k 2 } > 0 in ( fTi~| )) 


r ed : Rp < log (1 + C + S) - 5 log(2), 

(21a) 

R P < log(l + S + 1) - log(2), 

(21b) 

Rc < log(l + S) - log(3), 

(21c) 
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R P + Rc + log (1 + C) + log (1 + 




log (l 


+ 


V i + i 

Rp + R c < log (1 + S + I) + log I 1 + 


1 + C 
5 log(2) - log(3), 

S 


1 + 1 


- log(2) — log(3), 


(2 Id) 
(21e) 


R p + R c + log I 1 + 


C 


1 + 1 

-Rp + R c < log (1 + S) + log I 1 + 


+ log 1 + 


1 + C 

s s 


Rp + 2 R c < log (1 + S + I) + log I 1 + 


1+1 1+C 

s 


+ log(l + S)-41og(2)-log(3), (21f) 

■ 2 log(2) — log(3), (21g) 


1 + 1 


+ log (1 + S) — 3 log(2) — 2 log(3), (21h) 


Rp + 2 R c < log (1 + S) + log J 1 + 

C 


+ log 1 + I + 


log 1 


1 + 1 


1 + 1, 

— 4 log (2) — 2 log(3), 


1 + C 


(2 li) 


Rp + 3 R c < log (1 + S + I) + 2 log ( 1 + 




+ log 1 + I + 


1 + C 


1 + 1, 

log (1 + S) — 5 log(2) — 3 log(3). (2lj) 

For this regime, the outer bound in ( fid] ) can be further upper bounded (by considering the 
constraints in ( |14a| ), ( |14b| ), ( |14c| ), ( |14d| ) and ( |14i| )) 

O red : R p < log (1 + C + S), (22a) 

-Rp < log (1 + S + I) + log(2), (22b) 


Rc < log (1 + S), 
-Rp + -R c < log ( 1 + 


1 + 1 


+ log (1 + S + I) + log(2), 


(22c) 

(22d) 


-Rp + 2 R c < log (1 + S + I) + log | 1 + 


1 + 1 


+ log (1 + C) + 2 log(2) + log(3), (22e) 


where the inequality in ( |22e| ) follows since I + y+ < 2 max {1, 2+} < 2C. 

It is easy to see that the outer bound region in ( [22] ) and the achievable rate region in ( |2lj ) are 
to within 5 bits/user of one another. Notice that in order to prove a constant gap we compared: 
eq( [21a[ ) with eq( |22a[ ), eq( |21b[ ) with eq( |22b[ ), eq( |21c[ ) with eq( |22c| ), eq( |21d[ ) with eq( |22d[ ), eq( |21e| ) 


with eq(22d), eq(21f) with eq(22d), eq(21g) with eq(22d), eq(21h) with eq(22c)+eq(22d), eq(21i) 


with eq(|22e|), and eq(21 j) with eq(|22c[)+eq(|22e[). 
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3) Regime I < S < C < A ;/ , with A,/, defined in ( p~3| ) (yellow region in Fig. [7]): As remarked 
in item [3] in Section IV-B for this region we set U\ — T) — 0 in the transmission strategy in 
Appendix [E] i.e., the PTx uses only cooperative messages. With this choice and after performing 
the FME, we obtain the rate region in ( [30] ) in Appendix |E-B[ which evaluated for the Gaussian 
noise case gives the region in ( |3T| ). In ( f3T| ), for l p = l c = I and S p = S c = S, we set |ai| 2 = 
|&i| 2 = ., (1 I +|) , 16 2 1 2 = and |ci| 2 = |c 2 | 2 = y2_. Notice that with this choice of the power 


splits, we have |di| = 0, i.e., the power allocated for 7\ is zero. With these choices, we get that 
the achievable rate region in ( [31] ) can be further lower bounded (by considering min {k\ > 0 

and that the constraint in ( |31e| ) is redundant in ( [37] )) as 

jy eii ° w : f? p < log (1 + C) — log(2), 

R P < log(l + S + I) - log(2), 

Re < log(l + S) - log(2), 

R p + R c < log (1 + C) + log (1 + S + I) — 3 log(2), 


Re 


Re 


R c < log (1 + 
R c < log (1 + 


C 


1 + 1 

S 

m 


+ log (1 + S) - log(2), 


+ log (1 + S) — 2 log(2), 


R p + 2 R c < log (1 + S) + log I 1 + 


1 + 1 


Rp + 2 R c < log ( 1 + 


C 


1 + 1 


+ log (1 + S + I) + log (1 + S) - 3 log(2), 


Rp + 3 R c < 2 log (1 + S + I) + log (1 + S) + log ( 1 + 


1 + 1 



(23a) 


(23b) 


(23c) 


(23d) 


(23e) 


(23f) 

■ 4 log(2), 

(23g) 

' 3 log (2), 

(23h) 

- 6log(2). 

(23i) 


For this regime, the outer bound in ( |74j ) can be further upper bounded (by considering the 
constraints in ( |14a| ), ( |14b[ ), ( |14c[ ), and ( |14d| » 

0 yellow : R p < log (1 + C) + log(2), (24a) 

Rp < log (1 + S + I) + log(2), (24b) 

Rc < log (1 + S), (24c) 


R p + R c < log (1 


+ 




1 + 1 


+ log (1 + S + I) + log(2). 


(24d) 
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It is easy to see that the outer bound region in ( [24] ) and the achievable rate region in ( |23j ) 
are to within 2 bits/user of one another. Notice that in order to prove a constant gap we 


compared: eq( |23a[ ) with eq( |24a| ), eq( |23b| ) with eq( ]24b| ), eq( |23c[ ) with eq( |24c[ ), eq( |23d| ) with 
eq( |24a| )+eq( |24c| ), eq( |23e[ ) with eq( |24d[ ), eq( |23f| ) with eq( |24d[ ), eq( |23g[ ) with eq( |24c[ )+eq( |24d| ). 


eq(23h) with eq(24c)+eq(24d), and eq(23i) with 2eq(24c)+eq(24d). 


D. Discussion 


The two novel outer bounds 2 R p + R c in (14g) and R p + 2 R c in d 14i[ ) are active when 
S > max {C. 1 } (weak interference and weak cooperation, which corresponds to the red and 
green regions in Fig. [4]). In |[T9l . the authors interpreted the need of this type of bounds as a 
measure of the amount of the ‘resource holes’, or inefficiency, due to the distributed nature of 
the non-cooperative classical IC llT8l . Thus, in line with the work in [[191 . we conclude that when 
S > max{C, 1 } unilateral cooperation is too weak to allow for a full utilization of the channel 
resources, i.e., it leaves some system resources underutilized. In particular: 

• Strong interference (i.e., I > S): in this regime neither the capacity region of the non- 
cooperative Gaussian IC IIT81 nor the capacity region of the non-causal Gaussian CIC [|24l . 
have bounds of the type 2 R p + R c and R p + 2 R c . It turns out that these types of bounds 
are not necessary for the GCCIC either. 

• Weak interference and strong cooperation (i.e., I < S < C): for this regime the outer 
bound in ( fT4] ) equals (to within a constant gap) the outer bound on the capacity region for 
the non-causal Gaussian CIC Il24[ Theorem III. 1], which does not have bounds of the type 
2R p + R c and R p + 2 R c (see discussion in item |T] in Section IV-A[ ). In other words, in this 
regime the ideal non-causal cognition assumption at the CTx just provides a bounded rate 
increase compared to the more practical case of causal learning for the CTx through a noisy 
link. It hence follows that for this regime unilateral cooperation allows to fully utilize the 
channel resources m, i-e., the bounds of the type 2 R p + R c and R p + 2 R c are not active. 

• Weak interference and weak cooperation (i.e., S > max {C. 1}): for this regime the 
capacity region of the non-cooperative Gaussian IC has bounds of the type 2 R p + R c and 
R p + 2 R c d, while the one of the non-causal Gaussian CIC does not [|241 . From our 


constant gap result in this region, it follows that 2 R p + R c in (14g> and R p + 2R c in 


(|14i|) are both active. In other words, in this regime unilateral cooperation does not allow 
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enough coordination among the sources which results in some ‘resource holes’ as in the 
non-cooperative Gaussian IC. 


V. Conclusions 

In this work we studied the two-user CCIC, an interference channel where one capable 
full-duplex source, i.e., the cognitive CTx, cooperates with / assists the other source, i.e., the 
primary PTx, to convey information. In contrast to the original overlay cognitive paradigm, 
where the CTx a priori knows the message of the PTx, in the CCIC the CTx causally learns the 
primary’s data through a noisy in-band link. We first derived two novel outer bounds of the type 
2R P + R c and R p + 2R c on the capacity region of the injective semi-deterministic channel with 
independent noises at the two pairs. We then designed a transmission strategy based on binning 
and superposition encoding, partial-decode-and-forward relaying and simultaneous decoding and 
we derived its achievable rate region. We finally evaluated the outer and lower bounds on the 
capacity for the practically relevant Gaussian noise case and we proved that our bounds are a 
constant number of bits apart from one another for the symmetric case (i.e., the two direct links 
and the two interfering links are of the same strength) in weak interference when the cooperation 
link is weaker than a given threshold. We showed that the two novel outer bounds of the type 
2R p + R c and R v + 2 R c are active in weak interference when the cooperation link is weaker 
than the direct link, i.e., in this regime unilateral cooperation is too weak to allow for a full 
utilization of the channel resources. 


Appendix A 


Proof of the Markov chains in ([8a]) and ( f8b| ) 

We start by proving the two Markov chains in ([8a[)-([8b]) by using the FDG [f28ll . Fig. [5] proves 
the Markov chain in ( |8a| ), while Fig. [6] the one in ( |8b| ). The two proofs, without loss of generality, 
consider the time instant i = 3. According to |[28ll . we proceed through the following steps. 

1) Draw the directed graph Q\, which takes into consideration the dependence between the 
different random variables involved in the ISD CCIC considered. In particular, we define 


Zti = 


Zu 
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Fig. 5. Proof of the Markov chain in (8a) using the FDG. 


to consider the fact that the noises at the CTx and at the CRx can be arbitrarily correlated 
and we have 

= f(W p ), Y Pi = f(X Pi ,T ci ), T CI = f(X ci ,Z Pi ), T U = f(X Pi ,Z$, 

X ci = f(W c ,T f i - 1 ), Y ci = f(X ci ,T Pi ), T Pi — f(X Pi , Zf,), 

where with / we indicate that the left-hand side of the equality is a function of the random 
variables into the bracket. 

2) In Qi, highlight all the different nodes / random variables involved in the two Markov chains 
in (|8a])-(|8bl) we aim to prove. In particular, the random variables circled in magenta, given 
those circled in green, should be proved to be independent of those circled in grey. 

3) From the graph Q\, consider the subgraph Q-> which contains those edges and vertices 
encountered when moving backwards one or more edges starting from the colored (magenta, 
green and grey) random variables. The edges of the subgraph Q 2 are depicted with dashed 
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Fig. 6. Proof of the Markov chain in (|8b|) using the FDG. 


black lines in Fig. [5] and Fig. [6] and the vertices in Q 2 are all those touched by a dashed 
black line. 

4) From the graph remove all the edges coming out from the random variables in green 
(those which are supposed to d-separate the random variables colored in magenta and grey). 
In Fig.[5]and Fig. [6} this step is highlighted with red crosses on the edges which are removed. 
We let Q 3 be the subgraph obtained from Q 2 by removing all the edges with red crosses. 

5) From Q 3 , remove all the arrows on the edges, and obtain the undirected subgraph Q 4 . In 
Q 4 it is easy to see that, by starting from any grey node, it is not possible to reach any 


magenta node. This concludes the proof of the two Markov chains in (8a)- 
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Appendix B 


Proof of the sum-rate outer bound in (6f) 


By using the two Markov chains in (|8a|)-([8b|) we can now derive the sum-rate outer bound 
in (|6f|). This bound was originally derived in [|6l for the case of independent noises; here we 
extend it to the case when only the noises at the different source-destination pairs are independent, 
i.e., Py rc ,y c |Xp,x c in © is not a product distribution. By using Fano’s inequality and by providing 
the same genie side information as in [0, we have 


N(R p + R c — 2 e^v) 

< i {w p ,y p n ) + i (w c -y c n ) 

< I (W p , Y p n , T p n , T f N ) + I (w c - Y c n , T c n , Tf N ) 
=H(Y p N ,T p N ,T f N )-H(Y c N ,T c N ,T f N \W c ) 

+ H (Y c n , T c n , T f N ) - H (Y p N , T p n , T { n \W p ) . 


We now analyze and bound the two pairs of terms. First pair: 

H (Y p N ,T p N ,T f N ) — H (Y C N ,T C N ,T f N \W c ) 


(a) 


(b) 


(c) 


H (Y Pi , T Pi , T fi Iiy-\ T;-\ Tt 1 ) - H (Y C11 T ci , T H \Yr\Tt\Tt\ W c , X c *) 

i€[l:N] 

H (YpvT^TulYj- 1 ,^- 1 ,^- 1 ) - H (T Pi ,T ci ,T u \T p i -\T c i -\T f i -\W c ,X c i ) 

i£[l:N] 


< H (T Pi ,T u \T p i -\T f i ~ 1 ) - H (T Pi ,T u \T p i -\T f i -\W c ,Tj~ 1 ,X c i ) 


i£[l:N] 


= 0 because of (8b) 


5^ H (Y Pi \T Pi ,T u ) -H{T ci \T p \T^W cl Tr\X c \X;) 


ie[l:JV] 


(d) 


E H (n.|r Pi ,T f .) - H (Y n \T Pi ,T H ,X K ,X cl ), 

ie[l:AT] 


where: the equality in (a) follows by applying the chain rule of the entropy and since, for the 
ISD CCIC, the encoding function X ci (W c , Y p ~ 1 ) is equivalent to X ci (W c , the equality in 

(b) is due to the fact that Y c is a deterministic function of (X C ,T P ), which is invertible given 
X c ; the inequality in (c) is due to the conditioning reduces entropy principle; the equality in 
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(d) follows because of the ISD property of the channel and since the channel is memoryless. 
Second pair: 


H ( Y C N , T C N , T f N ) - H (Y p n , T p n , Tf N \W p ) 


(0 

E 

H 

(Y«, T a, 

T' 


- H 

{Ypii T pv 

1 -\r i — 1 rp i- 

\ 1 P 5 1 P 

- 1 ,T f i -\Wp,Xp i ) 


ie[l:JV] 









(£) 

E 

H 

{Yc i,T ci , 

TulYj- 1 ,^- 

^Tt 1 ) 

- H 

(T«, Tpv Tu 

Inn i -1 rp i- 

\ ± c > p 

-\rr\w p ,xj) 


ie[l:N] 









(g) 

< 

E 

H 

V 

(T ct \rr 

1 ,r f i “ 1 ) -h 

{T cl \T c l - 

1 rp i- 
? 

-\W p ,Tp l ~ l 

,A'p‘) 



= 0 because of (8a) 


(h) 


+ ^ H{T,^T cl )-H{T u \T c \Tr\W P) T;-\X p \X c l ) 

i£[l:N] 

+ ^ H (Y ci \T ci , T fi ) - H (T Pi \T c \ T f \ W p , Tp i ~ 1 ,X p i , X c *) 

i£[l:N] 

E H (T fi \T ci ) - H (T u \T ci , X Pi ,X ci ) 

i£[l:N] 

+ J2 H (Y ci \T ci ,T H ) - H (Y ci \T ci ,T fi ,X Pi ,X ci ) , 

i£[l:N] 


where: the equality in (e) follows by applying the chain rule of the entropy and since, given 
W p , X p is uniquely determined; the equality in (f) is due to the fact that Y p is a deterministic 
function of (X p , T c ), which is invertible given X p ; the inequality in (g) is due to the conditioning 
reduces entropy principle; the equality in (h) follows because of the ISD property of the channel 
and since the channel is memory less. 

By combining all the terms together, by introducing the time sharing random variable uni¬ 
formly distributed over [1 : N] and independent of everything else, by dividing both sides by N 
and taking the limit for N —>• oo we get the bound in ( |6f| ). We finally notice that by dropping 
the time sharing we do not decrease the bound. 


Appendix C 

Proof of the outer bound in ( [ITT ) 

By Fano’s inequality, by considering that the messages W p and W c are independent and by 
giving side information similarly to [|6||, we have 

N (R p + 2 R c — 3 ejv) 
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<I(W p ;Y p n )+2I(W c -Y c n ) 


< I (W p ; Y P N , T P N , T f N ) + I (W c ; Y C N ) + I (W c ; Y C N , T C N , T f N \W p ) 

< H (Y c n ) - H (Y c n , T c n , Tf N \W p , W c ) 

+ H (Y c n , T c n , Tf N \W p ) - H (Y p N , T p n , Tf N \W p ) 

+ H (: Y p n , T P N , T f N ) - H (y c n \w c ) . 


We now analyze each pair of terms. In particular, we proceed similarly as we did to prove 
the outer bound 2 R p + R c in ([TO]). 

First pair: 


H {Y C N ) — H (Y c n , T c n , T f N \W p , W c ) 

= Y H(Y c ^Yj- 1 )^H(Y ci ,T ci ,T u \W p ,W c X~\Tj-\T f i ~\X p \X^ 

i£[l:N] 

< Y H (Y ci ) - H (Y ci ,T ci ,T H \W p ,W c X-\Tj-\Tr\X p \X c ^ 

i£[l:N] 

= Y H - H ( Y ' C" T cn T fi \X pi , X ci ) . 

i£[l:N] 

Second pair: 


H (Y c n , T c n , T f N \W p ) - H (Y p n , T p N , T f N \W p ) 
= H (Y ci ,T ci ,T u \Y c i - 1 ,T c i -\T f i -\W p ,Xj) 

ie[l:JV] 

= Y H(Y ci ,T ci ,T u \Yr 1 ,T c i ~\T f i - 1 ,W p ,X p i ) 

ie[l:JV] 


H (Y Pi , T p ., T U \ V" 1 , V" 1 , Wp, AV) 

// (T ci , T Pi , Tf jlTc* -1 , Tp*' 1 , VF P , Ay) 


< H {T ci \T c l -\ Tr 1 ) - H {T cl \Tt\v_\ Tt\W p , Xj\ 

ieflW] q because of |8aJ 

+ Y H(T u \T ci ,X Pi )-H(T u \T c i ,T p i -\T f i -\W p ,X f *) 

i£[l:N] 

+ Y H(Y ci \T ci ,T u ,X Pi )-HiT^T^Tj-'X^X^Xj) 

fe[l:iV] 

= ]T H (T fi \T ci ,X Pi ) - H (T fi \T ci ,X Pi ) 

ie[l:JV] 

+ ^ H (y ci |T ci , Tfj, X p .) — H (T ci |T C j,T f j, A ci , A" Pi ) 

ie[l:N] 
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= ]T H(Y c ^T ci ,T u ,X Pi )^H(Y ci \T ci ,T u ,X ci ,X Pi ). 

te[l:JV] 

Third pair: since 


H (Y C N \W C ) 


= H(Y ci \Y c i ~ 1 ,W c ) 

i£[l:N] 

> Y H(Y cl \Yr\W c ,Tt\X c ') 

ie[l:AT] 

= Y, H(T Pi \Tj-\W c ,Tt\Xj) 

i£[l:N] 


= V H (Tp,|T p - 1 , r f - 1 ), 

ie[l:AT] 


where the last equality follows because of (8b), then 


H (Y p N ,T p N ,T f N ) - H (Y c n \W c ) 

< Y H {Y Pi ,T Pi , TfilYj- 1 , Tp* _1 , Tf'- 1 ) - H (TpjTp 4-1 , T f <_1 ) 

ie[l:N] 

< E ^(n„r,,|r Pi ). 

i€[l:N] 

By combining everything together, by introducing the time sharing random variable uniformly 
distributed over [1 : N] and independent of everything else, by dividing both sides by N and 
taking the limit for N —> oo we get the bound in (jTTJ). We finally notice that by dropping the 
time sharing we do not decrease the bound. 


Appendix D 

Evaluation of the outer bounds in @, (fToJ) and (FT} for the GCCIC 


By defining E [X P X C *] 


p : \p\ G [0,1] we obtain: from the cut-set bounds in (f6a])-(|6cl) 


R P < log (l + (C + S p ) (l-|p| 2 )) 

|p|=° 

< log (1 + C + S p ), (25a) 

Rp E log + S p + l c + 2A V /S p l c 9 t l {pe 

< log ^1 + + V^) ^ > (25b) 
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Rc < log (l + (l - |p| 2 ) S c ) 

|p|=o 

< log (1 + S c ). 


(25c) 


From the bounds in (|6d|)-(f6e|) we get 


R P + Rc + log ( 1 + 


(S P + C) (1 — \p\ 2 ) 
l + l P (l-|p| 2 ) 


+ 


log + S c + Ip + 2y / S c l p 9r {pel 0p 



(25 d) 


increasing in C 


and 


R P + Rc ^ log ( 1 + 

(b) ( 

< log 1 + 


5c(l-|p| 2 ) 

l + lc(l-|p| 2 ) 

S r 


+ log (\ + Sp + l c + 2y / S p l c 9 c t |p( 


-Pc 


1 + Ir 


+ log ( 1 + ( V S P + 



(25e) 


as no cooperation / C = 0 

where the inequality in (a) follows by evaluating the first logarithm in |p| = 0 and the second 
logarithm in p = e“- i6,p and the inequality in (b) follows by evaluating the first logarithm in 
|p| = 0 and the second logarithm in p = e j0c . Finally, from the bound in ([67]) we obtain 


Rp + R c < log 


+ log I 1 + 
+ log ( 1 + 


/ Sp + l c + 2^/SplcfK {pe 1 0C } + (1 — |p| 2 ) (l p l c + Clc) 
1 + 1 + C + lp 

S c + Ip + 2 y/ScIpfH {pej ep j + (1 — | p | 2 ) (lpl c + CSc) 




= log 1 + 


+ log 1 + 


1 + C + l c + l c C (1 — |p| 2 ) 

C + Cl c (1 — |p| 2 )' 

1 + lc 

5p + l c + 2 v / S^fH{pe-^} + (l - |p| 2 ) (l p l c + Cl c )' 

1 + C + I F 

c + Sc + Ip + 2^5j;9t {p+ ep } + (1 - |p| 2 ) (lpl c + C5 c + l c C) \ 

1 + lc J 
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< log ^1 + l c + 1+ ^- P + | ) + log ^1 + C + l p + Sc | 1 + 4 | + 21og(2), (25f) 

= log (l + C + Ip + + log (l + U + +2log(2), 

V.--v--—^ 

increasing in C 


where the inequality in (c) follows by: (i) evaluating the first term of the first logarithm in 
p = el 00 and the second term of the first logarithm in \p\ = 0; (ii) evaluating the first term of 
the second logarithm in p = e~ ]9p and the second term of the second logarithm in \p\ = 0; (iii) 
since log ^1 + + y/\b\^j ^ < log (1 + \a\ 2 + |6| 2 ) + log(2). 

We now evaluate the new outer bounds in Theorem |T| and we get 


2R r + < log (l + S p + l c + {pe-»}) + log (l + t + |p|2) ) 

+ / + C + S c + l p + 2 v ^Dt {pel"-} + (1 - |p| 2 ) (l p l c + CS c + l e C) \ 

1 T lc J 



(25g) 


+ log 


f 1 + l P + S p \ 
V i + lc + S c / 


+log (' + trips;) + log 0 + lc+Sc rryrc) + log(2) - 

" v----- y 

increasing in C 


where the inequality in (d) follows by (i) evaluating the first logarithm in p — e^ 9c , (ii) evaluating 
the second logarithm in \p\ = 0, (iii) evaluating the first term of the third logarithm in p — er ]0p 
and the second term of the third logarithm in \p\ — 0 and (iv) since log ^1 + ^ \J\ a \ 2 + 
log (1 + |a| 2 + |6| 2 ) + log(2). Similarly, 



R p + 2 R c < log ^1 + S c + l p + 2 a/S c I p 1H {pe- i6lp } j + log ^1 + ^ ^ ^ ^ —^pj 2 ) 

+ log (1 + 2 V S P l - m {pe~ j6>c } + (1 — \p\ 2 ) (lpl c + Cl c ) \ 

\ 1 H - C H - I p I 

+ log 0 + ip) 
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< log (1 + f 1 + i°s (i + 


log 1 + i c + 


i + c + Ir 


+ log 1 + 


1 + Ic 

c 

1 + Ir 


+ log(2), 


(25h) 


— log (i + - ^ P | ) + log (i + ys;+ ^Jv 9 


as no cooperation / C = 0 

log ( ! + | C + c C 1 + log (1 + C 


1 + Ip + S F 


1 + Ic 


+ l°g(2), 


increasing in C 

where the inequality in (e) follows by: (i) evaluating the first logarithm in p = e~^ p , (ii) 
evaluating the second logarithm in \p\ = 0 and (iii) evaluating the first term of the third 
logarithm in p = e^ 9c and the second term of the third logarithm in \p\ = 0 and again (iv) 
since log ^1 + (^\/\a\ 2 + \Z\b\^j ^ < log (1 + |a| 2 + |f>| 2 ) + log(2). 

Appendix E 

Achievable Scheme Based on Superposition Coding and Binning 




Ai (IVlcCji-li - ►17i(ITi CC)t _i, W\ cc j, Wlcn,t) - WicC't, Wlcn,ti tElpn.t) 


-5i(Wi cc,t— 1 5 tUlpCjt — 1 ) | (tUlcC^ —1 7 IE1 cc,tl Wlp C J-l , IEl pc,t ) 

W2cn,ti bl c )—*T2(Wl CC) t-l, W 2cn , t , &2C7 W2pn,t, t>2p) 


Fig. 7. Achievable scheme based on binning and superposition coding. 


We specialize the ‘binning+superposition’ achievable scheme in [[8j Section V], In ® Thereom 
V.l] the network comprises four nodes numbered from 1 to 4; nodes 1 and 2 are sources and 
nodes 3 and 4 are destinations; source node j E [ 1:2], with input to the channel X :J and output 
from the channel Y :j , has a message W 3 for node j + 2; destination node j 6 [3 : 4] has channel 
output Y 3 from which it decodes the message Wj_ 2 . Both users use rate splitting, where the 
messages of user 1 / primary are both non-cooperative and cooperative, while the messages of 
user 2 / cognitive are non-cooperative. In [)8l Section V], we set Y\ = S 2 = V 2 = Z 2 = 0, i.e., 
then f?! = R llc + R 10c + R Wn + Ru n , f? 2 = S 22n + R 20 n, to obtain a scheme that comprises: a 
cooperative common message (carried by the pair ( Q , Vi) at rate i?io c ) for user 1, a cooperative 
private message (carried by the pair (Si, Z x ) at rate S llc ) for user 1, a non-cooperative common 


March 26, 2015 


DRAFT 














42 


message (carried by U\ at rate R | 0 „) for user 1, a non-cooperative private message (carried 
by Ti at rate Rn n ) for user 1, a non-cooperative common message (carried by U 2 at rate 
f? 20 n) for user 2 and a non-cooperative private message (carried by T 2 at rate R 22n ) for user 
2. Here the pair (Q, Si) carries the ‘past cooperative messages’, and the pair (Vi, Zi) the ‘new 
cooperative messages’ in a block Markov encoding scheme. The channel inputs are functions 
of the auxiliary random variables, where X\ is a function of (Q, S\,Zi, V\. U\ , Ti) and X 2 is a 
function of (Q, Si, U 2 , T 2 ). 

a) Input distributions: The set of possible input distributions is 

Pq,S 1 ,Vi,Zi,Ui ,Ti ,.Yi ,U 2 ,T 2 ,X 2 

= PqPv 1 \qPu 1 ,t 1 \q,v 1 Ps 1 \qPz 1 \q,s 1 ,v 1 Pu2,t 2 \s 1 ,qPx 1 \q,s 1 ,z 1 ,v 1 ,u 1 ,t 1 Px 2 \q,s 1 ,U2,T2- (26) 

A schematic representation of the achievable scheme is given in Fig. [7J where a black arrow 
indicates superposition coding and a red arrow indicates binning. Note that the difference between 
Fig.[7]and [17; Fig. 10] is that in the achievable scheme in IfTTl Fig. 10] we set X\ = T t , X 2 = T 2 
and Ui — Si — Zi — 0, i.e., user 1 / primary only used a common cooperative message and a 
private non-cooperative message, while here also private cooperative as well as common non- 
cooperative messages are used. Similarly, the difference between Fig. [7] and IfTTl Fig. 11] is that 
in the achievable scheme in IfTTl Fig. 11] we set U\ — T\ — 0, i.e., the messages of user 1 / 
primary were only cooperative, while here we consider also non-cooperative (both private and 
common) messages for user 1 / primary. 

b) Encoding: The codebooks are generated as follows: first the codebook Q is generated; 
then the codebook Vi is superposed to 0, after the codebook U\ is superposed to {O. V )) and 
finally the codebook T) is superposed to (O. Vi, Ui); independently of (Vi, Ui, Ti), the codebook 
Si is superposed to 0 and then the codebook Z\ is superposed to ((), S\, V); independently of 
(Si, Z\,V\,U\,T\), the codebook U 2 is superposed to 0 and then the codebook T 2 is superposed 
to ( Q,U 2 ). With this random coding codebook generation, the pair ( U 2 ,T 2 ) is independent of 
Si conditioned on Q. tf8] Theorem V.l] involves several binning steps to allow for a large set 
of input distributions. Here the only binning steps are for ( U 2 ,T 2 ) against Si. 

We use a block Markov coding scheme to convey the message of user 1 to user 2. In 
particular, at the end of any given time slot in a block Markov coding scheme, encoder 2 knows 
(Q, Si, U 2 , T 2 ) and decodes (Vi, Z x ) from its channel output; the decoded pair (Vi, Z\) becomes 
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the pair (Q, Si) of the next time slot; then, at the beginning of each time slot, encoder 2, by 
binning, finds the new pair (U 2 , To) that is jointly typical with (0. Si); for this to be possible, we 
must generate several {U 2 , T 2 ) sequences for each message of user 2 so as to be able to find one 
pair to send with the correct joint distribution with ((). Si); this entails the rate penalties in © 
eq(20)] for user 1 and then again [HI eq(20)] for user 2 by swapping the role of the subscripts 1 
and 2, with S 2 — Z 2 — V 2 — 0, i.e., 

T 2 0n + T 22n >I{U 2 ,T 2 ;Si\Q), (27a) 

R' 20n >I(U 2 ;Si\Q). (27b) 

c) Decoding: The cooperative source uses the partial-decode-and-forward strategy and the 
destinations backward decoding. There are three decoding nodes in the network and therefore 
three groups of rate constraints. These are: 

• Node2 / CTx jointly decodes ( V), Z\) from its channel output with knowledge of the indices 
in (Q, Si,U 2 ,T 2 , X 2 ). Successful decoding is possible if (use (8} eq(21)] by swapping the 
role of the subscripts 1 and 2, with S 2 — Z 2 — V 2 — 0 and with I j independent of Si) 

Rioc + Rue < I(Y 2 ; Z u Vi\U 2 , T 2 , X 2 , Si,Q), (27c) 

Rnc < I{Y 2 ; Z1 1 U 2 , T 2 , X 2 , Si,Q , Vi). (27d) 

• Node3 / PRx jointly decodes (Q, Si, U 2 , U \, T x ) from its channel output, with knowledge of 
some message indices in (Vi,Zi), by treating T 2 as noise. Successful decoding is possible 
if (see (HI eq(22)] with S 2 = Z 2 = V 2 = 0) 


RlOc 

+ 

RlOn 

+ 

Rlln + S 2 0n + -Rile < I(Y 3 ; Q , Vi, U\. 

,T u Si,Zi, 

u 2 ) 




— 

(-^20n 

-I(U 2 ;Si\Q)), 




(27e) 

RlO n 

+ 

Rlln 

+ 

S 2 on + R nc < I(Y 3 ; U 2 , T 1; Si, Z l5 U 2 

\Q,Vi) 





— 

(-^20n 

-I(U 2 ;Si\Q)), 




(27f) 

RlOn 

+ 

Rlln 

+ 

Rue < I(Y 3 ;Ui,Ti,Si,Zi\Q,Vi,U 2 ), 




(27 g) 

-^lln 

+ 

R20n 

+ 

Ruc<I(Y 3 ;Ti,Si,Zi,U 2 \Q,Vi,Ui) 

~ (R20n ~ 

I(U 2 ; 

Si\Q)), 

(27h) 

R\0n 

+ 

Rlln 

+ 

R 20 n < I(Y 3 ; Ui, Ti, U 2 \Q, Si, Zi, V, ) 

~ (R20n ~ 

I(U 2 ; 

Si\Q)), 

(27i) 

Rlln 

+ 

Rile 

< 

I(Y 3 ;Ti,Si,Zi\Q,Vi,Ui,U 2 ), 




(27j) 
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-^20 n 

+ 

Rnc<I(Y 3 -,Si,Zi,U 2 \Q,Vi, 

Ui,Ti)- 

(-^20n 

- I(U 2 ] 

Si\Q)), 

(27k) 

-RlOn 

+ 

Rim<I(Y 3 -Ui,Ti\Q,Si,Zi, 

Vi,U 2 ), 




(271) 

Rlln 

+ 

R20n<I(Y 3] Ti,U 2 \Q,Si,Zi, 

Vi,Ui)- 

(-^20n 

- I(U 2 ; 

Si\Q)), 

(27m) 

Riic 

< 

I(Y 3 ,Si,Zi\Q,Vi,Ui,Ti,U 2 ), 





(27n) 

Rlln 

< 

I(Y 3 -Ti\Q,Si,Zi,Vi,Ui,U 2 ). 





(27o) 


. Node4 / CRx jointly decodes (Q, f/ L , U 2 , T 2 ) from its channel output, with knowledge of 
some message index in Vj, by treating 2j and T x as noise (recall that the pair (U 2 , T 2 ) 
has been precoded/binned against Si). Successful decoding is possible if (see BH eq(22)], 
with the role of the users swapped, where only the bounds in [[51 eq(22a)], (51 eq(22h)], 
BEl eq(22i)], BS1 eq(22j)], and BEl eq(22k)] remain after setting several auxiliary random 


variables to zero and removing the redundant constraints) 

Rioc + R20n + Rnri + RlOn S I(Y 4 -Q,U 2 ,T 2 ,V 1 ,U 1 )-(R' 20n + 

R 2211 ) 1 (27p) 

7?20n + R22n + RlOn < I(Y 4 -,U 2 ,T 2 ,Ui\Q,Vi). - (R' 20n + ^22n) ’ (27q) 

7?20n + 7?22n < I(Y A -,U 2 ,T 2 \Q,V 1 ,U 1 )-(lt 20n + 

R22n)i (27r) 

7?22n + RlOn Si I(Y 4 -T 2 ,Ui\Q,U 2 ,Vi) - R 22n , (27s) 

R 22 n < 7(n; T 2 \Q, U 2 , Vi, Ui) - R' 22n . (27t) 


d) Compact region: Instead of applying the Fourier-Motzkin Elimination (FME) directly 
on the general achievable rate region, in the following we apply the FME on two particular 
cases, namely the case when S\ — Z\ — 0, i.e., no private cooperative messages for the PTx 
and the case U\ = 0, i.e., no common non-cooperative message for the PTx. The first case is 


analyzed in Section E-A while the second case is analyzed in Section E-B For both cases we 
take the constraints in ( |27a| ) and ( |27b[ ) to hold with equality (i.e., R 20n = I(U 2 ; S'iIQ), R 22n = 
I{S x -T 2 \Q,U 2 )). 


A. FME on the achievable rate region when S± = Z x = 


We set S x — Z\ = 0 in the achievable rate region. After FME of the achievable region in ( |27| ) 
with Si — Zi — t (see also BH eq(8)]), we get 


Ri < eq(27e), 


(28a) 
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R\ < eq(27c) + eq(27g), 


R ‘2 < eq(27r), 


Ri + R2 < eq(27e) + eq(27t), 


R\ + R2 < eq(27j) + eq(27p>, 


Ri + R 2 < eq( 27c) + eq( 27i) + eq( 27t), 


Ri + R 2 < eq(|27c|) + eq(27j) + eq(27q), 


Ri + R 2 < eq(27c) + eq(27m) + eq(27s), 


2i?i + R 2 < eq(27c) + eq(27j) + eq(27e) + eq(27s), 


2R\ + R 2 < 2 ■ eq(27c) + eq(27j) + eq(27i) + eq(27s), 


R\ + 2R 2 < eq(27m) + eq(27s) + eq(27p), 


R\ + 2R 2 < eq(|27c|) + eq(|27m[) + eq(|27t|) + eq(27q). 


(28b) 

(28c) 

(28d) 

(28e) 

(28f) 

(28g) 

(28h) 

(28i) 

(28j) 

(28k) 

(281) 


for all distributions that factor as (J26]) and by setting S\ = Z\ = 0 in all the mutual information 
terms. 

We identify Nodel with the PTx (i.e., X p = AY), Node2 with the CTx (i.e., X c = X 2 , T f = Y 2 ), 
Node3 with the PRx (i.e., Y p = Y 3 ) and Node4 with the CRx (i.e., Y c = F 4 ). For the Gaussian 


noise channel, in the achievable region in ( [28] ), we choose Q = 0, we let V), Ui, T 1; U 2 , T 2 be 
i.i.d. A/”( 0 , 1 ), and 

|cq| 2 + \bi\ 2 + | Ci | J = 1 , 


\a 2 \ 2 + \b 2 \ 2 = 1 . 


X p — Oj\Ui + b\V] + C 1 T 1 : 

X c = a 2 U 2 + b 2 T 2 : 

With these choices, the channel outputs are 

Tf = VC (a\Ui + b\\ 1 + Ci7\) + Zf , 

Y p = y5~ p (cnU, + 61 Yi + ciTi) + ( a 2 U 2 + b 2 T 2 ) + Z p , 

Y c = \/f^e-’ e,p (ai(/i + b\V\ + CiTi) + (a 2 U 2 + b 2 T 2 ) + Z c , 


and the achievable region in ( |28| ) becomes 
Rp Y log 1 + Sc 


1 + lc |& 2 | 2 / ’ 


(29a) 
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R v < log 


1 + C 


a + C(|a, 1 p + | Cl P) 

log 0 + ITw) ’ 


A , , A , s p (|o .,| 2 + k,l 2 )\ 

J +!og d + i + W 2 J’ 


R P + R c < log 


1 + S p + l c 
1 + I i'-' 2 


lc 02 


) + log f 1 + TTQ+0 


i?p + i? c < log ( 1 + 
R P + -Rc < log 


5 P N 2 ) + log 

1 + C 


1 + S c + Ip 

1 + I p | Cl | 2 


(29b) 

(29c) 

(29d) 

(29e) 


1 + C (|a.! | 2 + |c, | 2 ) 

+log ( 1 + rrwF 

1 + C 


+ log 


/I + S p (|ai| 2 + |ci| 2 ) + l c 


V 


1 + l< 


(29f) 


R P + R c < log 


R p + R c < log 


l + Cda^ + ldl 2 ) 

1 + C 

l + Cda^ + ldl 2 ) 
Ip |<3-! | 2 + S c |£»21 2 


+ log ( 1 + OT) + ‘-( 1 + Td+F)' 


+ log 


1 + S p | Ci | + I, 
l + l c +- 12 




(29g) 


(29h) 


2R P + R c < log 


' HI I / 

( i + c \ . (. S p |d| 2 \ , dl + S p + l c 

(l + C (|ad 2 + |d| 2 ) J + 8 ( + 1 + lc|& 2 | 2 J + 8 ( 1 + IcN 2 

i i . 19 , r 1 7. 1 9 \ 


+‘4 + y rri+r 

1 + C 


2R P + R c < 2 ■ log 


(291) 


+ log ( 1 + 


, 1 + C (|a,!| 2 + |d| 2 ), 

+ log (dM+±J-0±k) + log ( 1 + t 


S P |cip 


V l + lc|&2| 2 

M 2 + ScN 2 


1 + Iplclp 


(29j) 


Rp + 2 R c < 


log f 1 + S >N , + l d + log (l + ++±W ) + tog 

g V i + hM 2 / e V i + Ipkil 2 J g 


1 + S c + Ip 

1 + I p|Ci| 2 


R p + 2 R c < log 


1 + C 


l + C(|ad 2 + |cd 2 ) 

+ ,og ( 1 + TOT)’ 


(29k) 

)++w+'«> (■*++ 


(291) 
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B. FME on the achievable rate region when U\ = 0 

We set Ui = 0 in the achievable rate region. After FME of the achievable region in ( [27] ) with 
Ui = 0, we get 


Ri < eq(27c) + eq(27o), 


Ri < eq(27e), 


R 2 < eq( 27r), 


Ri + R 2 < eq(27c) + eq(27i> + eq(27t), 


Ri + R 2 < eq(27e) + eq(27t), 


Ri + R 2 < eq(27d) + eq(27o) + eq(27p), 


R\ + R 2 < eq(27g) + eq(27p), 


Ri + 2R 2 < eq(27f) + eq(27p) + eq(27t), 


Ri + 2R 2 < eq(27d) + eq(27i) + eq(27p) + eq(27t), 


Ri + 3R 2 < eq(27k) + eq(27i) + eq(27p) + 2 • eq(27t), 


(30a) 

(30b) 

(30c) 

(30d) 

(30e) 

(30f) 

(30g) 

(30h) 

(30i) 

(30j) 


for all distributions that factor as ([26]) and by setting Ui — 0 in all the mutual information 
terms. 

Remark 3 After FME, the following rate constraints (with U\ = 0) also appear 


R 2 < eq(27m) + eq(27t), 


R 2 < eq( |27k[ ) + eq( |27t[ ). 

By following similar steps as in (\29\ Lemma 2] and Appendix A], it is possible to show 
that these constraints are redundant. In other words, if these constraints are active a larger rate 
region is attained by not sending any common message, i.e., by setting U 2 = 0. 

We identify Nodel with the PTx (i.e., X p = AY), Node2 with the CTx (i.e., X c = X 2 . 7} = Y 2 ), 
Node3 with the PRx (i.e., Y p = Y :i ) and Node4 with the CRx (i.e., Y c = Yf). For the Gaussian 
noise channel, in the achievable region in ( |30[ ), we choose Q = 0, we let Si, Vi, T), Z 1 , Uf T' 2 
be i.i.d. A/"(0,1), and 

X p = |ai|e j6,c <S'i + b\V\ + C\Z\ + dfTi : + |^i|^ + |ci|" + |<Y|~ = 1, 
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X c — ICZ.2 |‘S'l + b 2 U' 2 + c 2^2 : l°2| 2 + |^21 2 + |<^2 | 2 — lj 

T T _ tt' \ \ q \ _ 5 c | 6 2 | 2 _ v/^e^ej^lail + ys;|g 2 | 

2 2 17 1 ' u S c |6 2 | 2 + S c |c 2 | 2 + i + | p (| Cl | 2 +|d 1 | 2 ) VS ~b 2 

rr _r r , , , c , S c |c 2 | 2 + ^S~ c \a 2 \ - VS~cb 2 Xu 

2 2 rSl ' T Scl^P + l + lpdcP + KI 2 ) 

where the choice of A u is so as to “pre-cancel” Si from Y c in decoding U 2 , i.e., so as to 

have I(Y C \ U 2 |Vi, Q) — /(Si; U 2 \Q) = I(Y C ; U 2 \Vi, Q, Si) and the choice of \ T is so as to “pre- 
cancel” Si from Y c in decoding T 2 , i.e., so as to have I(Y C ; T 2 \Vi, Q, U 2 ) — /(Si; T 2 \Q, U 2 ) = 
/(y c ; T 2 \Vi, Q, U 2 , Si). With these choices, the channel outputs are 


Tf — VC (|ai|e j6lc Si + biVi + C1.Z1 + diTij + Zf, 

A p = (y / S^|ai| + \/ic|a2|)e^ c Si + \/S^(/iV + ci^i + d\Ti) + V^V^ (b 2 U' 2 + c 2 T^) + Z p , 

Yc — (v/i;e jep e j0c |ai| + \/S^|a2|)Si + (61 V\ + C1Z1 + d\Ti) + \/S~ c (b 2 U 2 + c 2 T 2 ) + Z c , 


and the achievable region in (f30|) becomes 


-Rp < log 1 + 


+ log 1 + 


R p < log 

R c < 

R p + R, 


C(N 2 + N 2 ) 
l + C|/i| 2 

1 + Sp + l c + 2 VS P I C |oi| 2 V 2 I 2 

1 + ic N 2 

lQ g fl + 5c(|/ 2 | 2 + |c 2 n \ 

H + l + l p (|ci| 2 + |/i| 2 )y'’ 


Sp|f/i| 2 
i + icN 2 ;’ 




+lc|/ 2 | 2 

M 2 


+ log ( 1 + 


Sc|c 2 p 


-Rp + -R c < log 


Rp + -R c < log I 1 + 


v 1 + I p (|ci| 2 + Mi| 2 )7 ’ 

1 + Sp + l c + 2 VSpIc l a i| 2 V 2 I 2 


1 + UN 2 


+i ° g (* + 1 +w i al + 1 w 


C|ci| ; 


i + c|di | 2 


+ log 1 + 


Sp|/i| 2 

l + lc|c 2 | 2 


, , A , S c (|/ 2 | 2 + |c 2 1 2 ) ^ , , 

+ log v + i + i P (N 2 + Mil 2 )/ +fcl ’ 


-Rp + Rc < log ( 1 + Jp ^ Cl ,l -4-141 ^ + log ( 1 + 1 “V'V' 19 T 3 121 ) + h + V, 


l + lc|c 2 | 2 ) 


s c (M 2 +1 c 2 1 2 ) 


1 + Ip(|Cl 1 2 + |/l| 2 ) 


Rp + 2R C < log 


A S p (I Cl 1 2 + |di| 2 ) + (v^S^|«i | + VU|a 2 |) + lc|&2 h 

1 1 + icN 2 




(31a) 

(31b) 

(31c) 

(3 Id) 
(31e) 

(3 If) 
(3 lg) 
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+ log 1 + 


s c (N 

2 

+ 

M 

I 2 ) 

1 + lp( d 

2 + M 

I 2 ) 


+ log 1 + 


ScM 


1 + lp(|ci| 2 + | rfi | 


+ fci, 


(3 lh) 


R p + 2 R c < log ( 1 + -— 


V l + ci^i 2 


+ log 1 + 


S p |rfi| 2 + l c |6 2 | 


1 + lc IC21 


+ log 1 + 


s c (M s 

! + M 2 ) 

1 + lp(|C] 

i 2 + M 

I 2 ) 


+ log 1 + 


ScM 


i + Ipdcil 2 + Mil 2 ) 


+ ki, 


(311) 


-Rp + 3R C < log I 1 + 


+ log 1 + 


Sp Cl 2 + (ly/S)) 

Mi 

+ sft~c\a 2 \ 

) 2 + lc|M | 2 

1 + lc 

|c 2 | 

2 


s c (N 

2 

+ 

M 

I 2 ) 

1 + lp(|d 

2 + Mi 

I 2 ) 


+ 2 log 1 + 


s c | 

c 2 | 

2 

1 + lp(|d 

2 

+ Mi 

I 2 ) 


+ ki, 


(3 lj) 


where we defined ki := I (Y c \ V)) and k 2 : = I (Y p : Ri|Vi, UR without evaluating them for the 


Gaussian noise case. Actually, further lower bounding /;:j and k 2 by zero suffices to prove a 
constant gap for the yellow and red regions in Fig. [4| 
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